-- Logs begin at Thu 2022-08-04 09:40:58 UTC, end at Thu 2022-08-04 10:41:53 UTC. -- Aug 04 10:16:46.532700 dv-cinder-826608-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 10:16:46.541982 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 10:16:46.544007 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 10:16:46 2022] *** Aug 04 10:16:46.544007 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 10:16:46.544007 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 10:16:46.544007 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: nodename: dv-cinder-826608-8-iscsi Aug 04 10:16:46.544007 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: machine: x86_64 Aug 04 10:16:46.544007 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: clock source: unix Aug 04 10:16:46.544007 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: pcre jit disabled Aug 04 10:16:46.544007 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: detected number of CPU cores: 4 Aug 04 10:16:46.544007 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: current working directory: / Aug 04 10:16:46.544007 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: detected binary path: /usr/bin/uwsgi-core Aug 04 10:16:46.544680 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: your processes number limit is 47680 Aug 04 10:16:46.544680 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: your memory page size is 4096 bytes Aug 04 10:16:46.544680 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: detected max file descriptor number: 2048 Aug 04 10:16:46.544680 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: lock engine: pthread robust mutexes Aug 04 10:16:46.544680 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: thunder lock: enabled Aug 04 10:16:46.544680 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 10:16:46.544680 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 10:16:46.584697 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: Python main interpreter initialized at 0x5633c1af09c0 Aug 04 10:16:46.584697 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: python threads support enabled Aug 04 10:16:46.584697 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: your server socket listen backlog is limited to 100 connections Aug 04 10:16:46.584697 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: your mercy for graceful operations on workers is 90 seconds Aug 04 10:16:46.585103 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 10:16:46.585103 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: *** Operational MODE: preforking *** Aug 04 10:16:46.585362 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: *** uWSGI is running in multiple interpreter mode *** Aug 04 10:16:46.585362 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: spawned uWSGI master process (pid: 103189) Aug 04 10:16:46.585555 dv-cinder-826608-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 10:16:46.586129 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: spawned uWSGI worker 1 (pid: 103190, cores: 1) Aug 04 10:16:46.586428 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: spawned uWSGI worker 2 (pid: 103191, cores: 1) Aug 04 10:16:46.588324 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 10:16:47.244431 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 10:16:47.245020 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 10:16:48.327168 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:16:48.327168 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: from cryptography.utils import int_from_bytes Aug 04 10:16:48.327931 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:16:48.327931 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: from cryptography.utils import int_from_bytes Aug 04 10:16:48.328101 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:16:48.328101 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: from cryptography.utils import int_from_bytes Aug 04 10:16:48.328101 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:16:48.328101 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: from cryptography.utils import int_from_bytes Aug 04 10:16:50.826998 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 10:16:50.827582 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 10:16:50.827940 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 10:16:50.828071 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 10:16:50.828156 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 10:16:50.828231 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 10:16:50.828318 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 10:16:50.828406 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 10:16:50.828492 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 10:16:50.828577 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 10:16:50.828741 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.828878 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.829059 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.829153 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.829377 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.829466 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.829742 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.829854 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.830022 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.830163 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.830327 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.830455 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.830643 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.830768 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.830961 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.831089 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.831284 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.831371 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.831542 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.831638 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.832371 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.832480 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.832704 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-8-iscsi {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.832817 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-8-iscsi {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.833025 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.833135 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.833332 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.833420 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.833640 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.833737 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.833948 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.834034 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.834251 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.834335 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.834565 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.834661 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.834863 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.834949 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.835346 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.835449 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.835772 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.835866 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.836095 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.836182 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.836404 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.836509 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.836735 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.836835 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.837038 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.837123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.837343 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.837450 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.837655 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.837740 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.837956 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.838050 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.838272 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.838374 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.838578 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.838674 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.838966 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-8-iscsi {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.839064 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-8-iscsi {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.839274 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.839365 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.839598 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.839744 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.839886 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.839991 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.840319 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.840435 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.840627 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.840714 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.840930 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.841021 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.841243 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.841338 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.841559 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.841658 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.841860 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.841952 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.842177 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.842264 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.842489 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.842582 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.842801 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.842899 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.843113 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.843206 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.843409 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.843493 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.843711 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.843805 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.844034 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.844126 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.844349 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.844435 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.844645 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.844739 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.844944 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.845030 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.845189 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.845280 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.845571 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.845705 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.845891 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.845987 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.846209 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.846306 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.846527 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.846634 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.846823 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.846916 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.847006 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.847079 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.847324 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.847419 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.848199 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.848296 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.848508 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.848615 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.848817 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.848908 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.849123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.849215 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.849427 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.849529 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.849730 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.849846 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.850035 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.850154 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.850337 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.850435 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.850638 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.850732 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.850950 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.851044 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.851256 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.851352 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.851570 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.851664 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.851871 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.851976 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.852209 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.852306 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.852596 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.852689 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.852842 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.852934 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.853141 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.853226 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.853472 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.853561 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.853781 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.853866 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.854081 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.854168 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.854394 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.854479 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.854705 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.854789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.855004 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.855089 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.855301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.855393 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.855599 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.855698 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.855911 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.856014 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.856259 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.856343 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.856561 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.856675 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.856809 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.856915 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.857101 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.857193 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.857400 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.857499 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.857710 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.857795 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.858008 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.858094 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.858307 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.858400 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.858605 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.858697 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.858899 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.858996 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.859197 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.859302 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.859493 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.859579 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.859787 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.859880 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.860111 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.860259 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.860412 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.860498 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.860710 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.860816 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.861016 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.861130 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.861314 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.861417 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.861614 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.861706 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.861927 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.862019 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.862242 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.862333 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.862543 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.862634 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.862843 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.862935 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.863165 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.863266 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.863464 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.863555 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.863777 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.863867 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.864102 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.864196 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.864406 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.864496 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.864721 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.864811 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.865020 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.865110 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.865316 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.865415 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.865626 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.865723 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.865924 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.866014 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.866223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.866323 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.866533 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.866630 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.866827 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.866919 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.867127 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.867226 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.867435 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.867525 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.867734 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.867824 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.868055 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.868166 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.868353 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.868443 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.868649 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.868746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.868946 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.869054 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.869243 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.869347 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.869538 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.869628 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.869832 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.869930 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.870123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.870229 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.870434 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.870527 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.870741 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.870834 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.871044 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.871135 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.871340 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.871430 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.871637 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.871735 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.871945 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.872076 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:16:50.872293 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.872386 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.872618 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.872710 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.872950 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.873043 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.873261 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.873351 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.873584 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.873682 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.873906 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.873997 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.874223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.874322 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.874531 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.874630 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.874839 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.874932 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.875156 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.875257 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.875459 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.875549 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.875762 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.875852 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.876087 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.876191 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.876398 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.876490 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.876709 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.876897 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.877036 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.877156 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.877347 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.877444 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.877657 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.877753 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.877969 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.878066 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.878273 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.878360 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.878583 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.878672 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.878928 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.879024 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.879242 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.879343 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.879548 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.879647 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.879879 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.879984 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.880243 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.880330 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.880549 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.880632 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.880866 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.880966 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.881181 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.881283 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.881484 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.881579 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.881787 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.881874 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.882088 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.882173 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.882402 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.882498 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.882724 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.882819 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.883028 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.883113 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.883337 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.883432 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.883640 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.883739 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.883945 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.884065 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.884276 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.884377 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.884577 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.884662 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.884880 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.884979 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.885205 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.885300 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.885511 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.885604 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.885818 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.885905 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.886123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.886220 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.886433 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.886526 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.886738 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.886823 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.887039 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.887128 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.887342 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.887428 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.887637 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.887730 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.887934 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.888053 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.888254 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.888341 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.888556 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.888640 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.888850 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.888945 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.889162 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.889254 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.889477 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.889660 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.889759 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.889842 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.890084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.890171 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.890382 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.890481 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.890683 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.890775 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.890983 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.891164 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.891322 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.891414 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.891568 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.891661 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.891868 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.891980 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.892198 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.892306 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.892498 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.892593 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.892817 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.892903 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.893123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.893219 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.893425 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.893511 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.893743 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.893840 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.894040 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.894135 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.894841 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.894933 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.895159 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.895244 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.895463 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.895559 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.895768 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.895863 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.896094 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.896184 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.896403 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.896491 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.896717 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.896804 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.897023 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.897116 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.897328 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.897415 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.897907 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.898040 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.898148 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.898248 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.898329 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.898407 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.898559 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.898653 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.898877 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.898971 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.899185 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.899278 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.899480 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.899566 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.899784 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.899895 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.900101 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.900198 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.900401 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.900500 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.900697 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.900796 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.900996 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.901090 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.901292 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.901376 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.901586 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.901674 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.901880 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.901966 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.902175 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.902260 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.902468 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.902561 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.902781 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.902875 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.903079 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.903165 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.903374 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.903469 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.903672 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.903784 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.903972 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.904063 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.904321 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.904415 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.904617 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.904711 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.904947 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.905047 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.905274 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.905372 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.905586 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.905670 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.905898 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.905993 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.906201 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.906290 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.906507 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.906601 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.906810 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.906909 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.907114 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.907245 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.907416 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.907502 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.907724 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.907842 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.908084 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.908186 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.908369 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.908490 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.908685 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.908805 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.908991 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.909110 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.909312 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.909426 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.909621 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.909730 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.909936 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.910687 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.910813 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.910989 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.911117 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.911299 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.911454 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.911632 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.911784 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.911990 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.912125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.912285 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.912443 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.912601 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.912751 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.912904 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.913062 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.913211 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.913366 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.913513 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.913675 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.913816 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.913980 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.914116 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.914293 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.914424 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.914608 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.914735 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.914914 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.915036 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.915225 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.915343 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.915529 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.915630 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.915847 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.915933 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.916177 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.916267 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.916491 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.916591 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.916791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.916876 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.917096 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.917182 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.917417 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.917510 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.917741 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.917827 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.918041 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.918138 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.918346 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.918433 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.918658 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.918743 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.918959 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.919052 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.919262 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.919355 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.919563 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.919648 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.919860 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.920013 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.920184 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.920272 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.920487 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.920571 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.920793 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.920892 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.921093 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.921181 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.921392 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.921479 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.921689 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.921792 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.921994 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.922089 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.922292 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.922377 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.922587 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.922684 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.922882 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.922966 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.923184 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.923283 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.923502 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.923603 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.923807 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.923894 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.924165 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.924270 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.924467 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.924569 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.924765 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.924853 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.925063 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.925148 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.925377 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.925474 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.925710 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.925797 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.926010 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.926097 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.926308 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.926394 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.926863 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.926955 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.927195 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.927282 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.927500 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.927595 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.927795 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.927880 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.928126 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.928214 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.928440 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.928527 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.928743 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.928828 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.929046 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.929145 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.929349 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.929434 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.929649 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.929735 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.929960 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.930089 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.930263 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.930350 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.930562 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.930646 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.930864 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.931026 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.931150 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.931240 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.931453 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.931550 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.931754 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.931851 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.932092 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.932182 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.932392 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.932477 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.932696 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.932782 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.932998 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.933083 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.933294 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.933379 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.933596 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.933689 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.933904 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.933989 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.934469 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.934554 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.934792 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.934878 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.935100 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.935186 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.935412 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.935496 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.935721 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.935807 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.936054 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.936143 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.936378 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.936480 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.936695 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.936782 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.937023 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.937117 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.937319 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.937420 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.937621 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.937704 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.937914 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.938009 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.938211 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.938296 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.938511 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.938607 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.938808 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.938897 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.939109 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.939210 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.939407 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.939503 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.939711 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.939798 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.940038 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.940142 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.940341 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.940441 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.940641 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.940726 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.940935 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.941019 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.941265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.941363 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.941563 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.941649 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.941864 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.941962 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.942160 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.942255 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.942475 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.942577 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.942776 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.942862 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.943070 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.943157 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.943366 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.943453 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.943660 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.943746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.944012 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.944102 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.944317 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.944402 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.944644 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.944730 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.944964 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.945051 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.945294 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.945387 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.945594 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.945689 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.945892 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.945986 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.946206 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.946291 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.946502 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.946602 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.946798 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.946885 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.947092 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.947177 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.947391 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.947490 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.947692 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.947779 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.948003 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.948093 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.948308 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.948406 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.948608 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.948694 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.948911 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.948995 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.949209 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.949295 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.949504 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.949590 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.949806 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.949904 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.950101 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.950194 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.950404 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.950492 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.950701 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.950795 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.950993 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.951080 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.951285 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.951371 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.951584 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.951670 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.951880 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.951985 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.952199 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.952284 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.952496 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.952581 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.952788 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.952883 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.953097 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.953182 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.953389 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.953488 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.953685 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.953771 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.953979 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.954071 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.954283 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.954452 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.954586 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.954672 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.954885 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.954971 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.955202 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.955302 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.955506 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.955594 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.955806 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.955891 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.956128 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.956230 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.956433 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.956519 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.956730 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.957316 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.957551 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.957638 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.957856 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.957941 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.958172 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.958259 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.958479 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.958572 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.958773 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.958857 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.959073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.959158 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.959367 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.959452 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.959663 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.959757 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.959975 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.960063 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.960279 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.960420 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.960571 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.960656 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.960864 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.960965 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.961157 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.961241 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.961449 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.961534 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.961743 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.961882 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.962056 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.962149 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.962354 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.962447 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.962649 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.962741 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.962945 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.963030 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.963239 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.963323 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.963571 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.963665 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.963866 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.963970 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.964246 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.964344 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.964544 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.964631 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.964859 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.964945 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.965171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.965262 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.965475 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.965562 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.965775 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.965860 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.966080 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.966165 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.966376 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.966469 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.966683 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.966774 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.966983 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.967068 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.967286 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.967373 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.967581 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.967667 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.967876 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.968029 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.968211 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.968297 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.968515 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.968601 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.968817 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.968923 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.969128 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.969214 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.969441 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.969535 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.969755 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.969851 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.970051 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.970138 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.970396 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.970496 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.970658 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.970761 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.970958 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.971045 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.971261 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.971347 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.971564 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.971652 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.971869 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.971985 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.972199 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.972286 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.972563 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.973154 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.973344 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.973431 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.973652 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.973738 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.973952 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.974039 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.974254 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.974340 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.974557 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.974683 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.974858 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.974946 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.975175 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.975259 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.975476 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.975570 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.975773 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.975858 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.976097 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.976186 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.976395 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.976492 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.976696 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.976781 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.976992 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.977079 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.977410 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.977507 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.977714 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.977800 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.978018 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.978113 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.978315 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.978414 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.978619 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.978704 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.978920 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.979005 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.979228 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.979313 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.979532 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.979624 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.979828 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.979913 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.980262 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.980358 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.980567 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.980652 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.980866 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.980954 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.981169 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.981258 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.981466 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.981550 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.981762 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.981846 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.982063 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.982148 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.982376 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.982462 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.982672 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.982765 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.982966 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.983052 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.983265 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.983351 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.983577 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.983737 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.983875 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.983985 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.984210 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.984308 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.984618 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.984718 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.984924 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.985009 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.985219 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.985304 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.985625 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.985726 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.985935 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.986363 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.986714 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.986841 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.986979 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.987089 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.987213 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.987213 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.987441 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.987671 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.987844 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.988170 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.988316 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.988434 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.988550 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.988666 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.988780 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.988896 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.989020 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.989220 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.989352 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.989538 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.989660 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.989844 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.989976 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.990153 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.990272 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.990451 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.990585 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.990764 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.990901 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.991079 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.991219 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.991416 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.991603 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.991792 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.991916 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.992129 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.992248 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.992373 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.992489 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.992675 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.992796 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.992973 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.993105 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.993279 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.993401 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.993576 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.993706 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.993870 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.993988 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.994171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.994302 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.994518 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.994637 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.994752 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.994866 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.995051 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.995181 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.995351 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.995478 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.995652 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.995784 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.995946 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.996284 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.996584 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.996678 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.996897 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.996992 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.997197 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.997293 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.997496 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.997584 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.997811 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.997904 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.998109 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.998203 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.998423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.998509 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.998727 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.998813 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.999027 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.999127 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.999326 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.999413 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.999623 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.999718 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:50.999938 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.000047 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.000262 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.000349 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.000560 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.000645 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.000858 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.000954 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.001153 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.001241 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.001494 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.001578 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.001823 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.001912 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.002147 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.002236 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.002461 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.002560 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.002775 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.002861 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.003080 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.003175 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.003380 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.003475 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.003680 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.004322 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.004512 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.004600 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.004812 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.004913 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.005121 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.005212 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.005422 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.005510 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.005717 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.005816 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.006014 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.006106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.006313 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.006403 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.006610 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.006705 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.006909 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.006995 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.007209 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.007293 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.007503 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.007591 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.007798 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.007884 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.008116 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.008206 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.008416 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.008503 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.008713 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.008801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.009025 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.009157 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.009326 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.009414 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.009623 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.009711 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.009936 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.010039 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.010216 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.010304 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.010542 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.010636 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.010837 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.010933 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.011151 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.011237 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.011453 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.011538 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.011763 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.011857 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.012093 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.012266 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.012407 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.012507 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.012695 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.012796 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.013003 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.013097 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.013309 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.013394 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.013619 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.013706 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.013930 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.014132 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.014219 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.014456 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.014552 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.014766 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.014857 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.015081 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.015175 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.015390 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.015618 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.015706 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.015943 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.016043 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.016278 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.016365 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.016587 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.016676 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.016895 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.016982 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.017199 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.017293 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.017523 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.017617 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.017840 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.017928 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.018161 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.018257 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.018464 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.018553 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.018767 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.018854 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.019089 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.019184 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.019449 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.020081 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.020281 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.020377 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.020633 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.020732 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.020942 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.021036 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.021243 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.021338 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.021550 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.021645 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.021856 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.021941 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.022166 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.022262 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.022471 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.022557 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.022777 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.022864 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.023079 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.023174 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.023385 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.023471 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.023688 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.023773 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.024010 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.024102 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.024315 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.024401 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.024623 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.024708 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.024945 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.025034 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.025278 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.025365 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.025587 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.025686 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.025894 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.025981 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.026205 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.026292 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.026516 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.026612 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.026839 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.027036 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.027151 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.027348 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.027456 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.027677 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.027774 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.028018 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.028108 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.028342 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.028575 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.028674 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.028882 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.028975 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.029208 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.029295 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.029524 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.029621 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.029830 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.029925 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.030134 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.030228 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.030437 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.030526 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.030733 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.030827 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.031035 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.031142 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.031331 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.031426 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.031628 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.031713 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.031924 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.032072 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.032244 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.032343 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.032558 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.032767 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.032942 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.033108 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.033242 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.033421 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.033552 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.033742 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.033835 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.034063 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.034364 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.034451 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.034665 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.034750 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.035005 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.035145 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.035314 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.035401 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.035615 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.035702 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.035927 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.036063 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.036255 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.036343 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.036555 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.036641 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.036855 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.036951 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.037159 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.037246 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.037465 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.037560 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.037765 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.037861 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.038063 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.038149 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.038360 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.038453 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.038664 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.038754 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.038967 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.039052 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.039262 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.039355 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.039558 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.039645 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.039853 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.039939 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.040175 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.040261 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.040476 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.040577 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.040783 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.040878 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.041070 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.041170 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.041372 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.041458 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.041668 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.041761 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.041965 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.042062 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.042262 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.042350 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.042556 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.042650 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.042852 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.042948 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.043146 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.043232 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.043442 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.043527 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.043735 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.043830 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.044063 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.044167 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.044360 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.044455 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.044660 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.044748 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.044955 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.045042 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.045269 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.045363 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.045566 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.045661 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.045887 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.045973 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.046203 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.046289 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.046506 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.046594 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.046822 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.047040 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.047127 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.047371 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.047467 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.047687 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.047781 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.048046 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.048135 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.048384 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.048578 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.048705 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.048907 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.048994 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.049218 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.049314 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.049546 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.049641 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.049868 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.049953 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.050167 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.050262 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.050468 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.050563 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.050794 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.050882 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.051100 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.051194 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.051403 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.051490 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.051997 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.052103 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.052302 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.052390 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.052605 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.052691 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.052910 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.052994 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.053211 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.053300 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.053515 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.053601 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.053818 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.053904 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.054120 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.054206 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.054420 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.054519 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.054723 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.054819 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.055025 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.055112 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.055326 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.055420 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.055627 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.055726 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.055939 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.056088 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.056280 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.056377 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.056586 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.056683 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.056892 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.056980 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.057199 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.057292 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.057506 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.057593 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.057809 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.057896 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.058111 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.058196 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.058409 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.058504 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.058709 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.058839 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.059017 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.059111 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.059337 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.059426 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.059641 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.059727 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.059938 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.060085 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.060343 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.060428 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.060662 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.060757 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.060969 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.061066 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.061282 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.061368 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.061585 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.061671 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.061898 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.061999 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.062211 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.062298 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.062514 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.062601 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.062828 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.062922 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.063130 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.063216 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.063430 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.063515 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.063733 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.063820 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.064067 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.064176 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.064381 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.064490 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.064687 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.064796 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.064987 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.065096 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.065289 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.065392 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.065594 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.065681 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.065894 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.065982 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.066697 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.066808 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.067015 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.067102 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.067336 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.067424 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.067642 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.067741 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.067943 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.068068 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.068265 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.068361 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.068560 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.068656 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.068858 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.068946 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.069154 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.069252 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.069450 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.069537 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.069746 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.069832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.070042 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.070136 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.070339 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.070427 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.070635 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.070721 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.070930 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.071017 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.071226 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.071321 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.071519 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.071605 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.071817 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.071916 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.072139 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.072229 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.072436 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.072560 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.072729 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.072825 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.073050 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.073137 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.073374 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.073459 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.073679 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.073774 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.073995 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.074080 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.074297 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.074382 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.074602 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.074701 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.074902 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.074988 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.075212 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.075349 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.075523 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.075623 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.075828 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.075916 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.076153 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.076241 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.076461 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.076557 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.076764 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.076851 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.077110 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.077211 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.077368 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.077458 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.077670 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.077759 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.077972 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.078067 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.078271 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.078359 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.078587 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.078672 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.078901 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.079042 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.079196 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.079283 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.079514 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.079657 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.079816 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.079917 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.080145 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.080234 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.080451 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.080538 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.080759 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.080859 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.081066 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.081163 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.081377 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.081471 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.081683 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.081773 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.082522 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.082655 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.082833 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.082920 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.083144 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.083232 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.083458 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.083543 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.083763 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.083852 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.084116 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.084209 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.084441 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.084527 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.084756 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.084853 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.085076 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.085165 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.085390 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.085475 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.085691 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.085787 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.086014 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.086110 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.086334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.086428 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.086641 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.086735 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.086943 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.087083 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.087169 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 10:16:51.087291 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.087611 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.087920 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.088249 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.088549 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:16:51.088787 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 10:16:51.240497 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO dbcounter [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] Registered counter for database nova_api Aug 04 10:16:51.242574 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO dbcounter [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] Registered counter for database nova_api Aug 04 10:16:51.262560 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_db.sqlalchemy.engines [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:16:51.264384 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG oslo_db.sqlalchemy.engines [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:16:51.269451 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG dbcounter [-] [103190] Writer thread running {{(pid=103190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:16:51.271453 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG dbcounter [-] [103191] Writer thread running {{(pid=103191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:16:51.325150 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.context [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),393fd0ff-f1f5-4df3-b996-afcdc2a85538(cell1) {{(pid=103190) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 10:16:51.327105 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.context [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),393fd0ff-f1f5-4df3-b996-afcdc2a85538(cell1) {{(pid=103191) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 10:16:51.329284 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:16:51.330921 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:16:51.331020 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG oslo_concurrency.lockutils [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:16:51.331705 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:16:51.333257 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG oslo_concurrency.lockutils [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:16:51.334053 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG oslo_concurrency.lockutils [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:16:51.334255 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:16:51.336068 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG oslo_concurrency.lockutils [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:16:51.336214 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO dbcounter [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] Registered counter for database nova_cell0 Aug 04 10:16:51.338048 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO dbcounter [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] Registered counter for database nova_cell0 Aug 04 10:16:51.341480 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO dbcounter [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] Registered counter for database nova_cell1 Aug 04 10:16:51.343436 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO dbcounter [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] Registered counter for database nova_cell1 Aug 04 10:16:51.349264 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_db.sqlalchemy.engines [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:16:51.350261 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_db.sqlalchemy.engines [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:16:51.351943 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG oslo_db.sqlalchemy.engines [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:16:51.355795 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG oslo_db.sqlalchemy.engines [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:16:51.357365 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG dbcounter [-] [103191] Writer thread running {{(pid=103191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:16:51.357587 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG dbcounter [-] [103190] Writer thread running {{(pid=103190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:16:51.359027 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG dbcounter [-] [103190] Writer thread running {{(pid=103190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:16:51.497524 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG dbcounter [-] [103191] Writer thread running {{(pid=103191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:16:51.502660 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO dbcounter [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] Registered counter for database nova_cell0 Aug 04 10:16:51.506567 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO dbcounter [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] Registered counter for database nova_cell0 Aug 04 10:16:51.511461 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_db.sqlalchemy.engines [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:16:51.515404 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG oslo_db.sqlalchemy.engines [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:16:51.516173 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG dbcounter [-] [103190] Writer thread running {{(pid=103190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:16:51.519822 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG dbcounter [-] [103191] Writer thread running {{(pid=103191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:16:51.855348 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: WARNING keystonemiddleware.auth_token [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:16:51.862702 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: WARNING keystonemiddleware.auth_token [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:16:51.876859 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: WARNING keystonemiddleware.auth_token [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:16:51.884073 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: WARNING keystonemiddleware.auth_token [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:16:52.205245 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: WARNING keystonemiddleware.auth_token [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:16:52.211143 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: WARNING keystonemiddleware.auth_token [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:16:52.216452 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5633c1af09c0 pid: 103190 (default app) Aug 04 10:16:52.218498 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:16:52.219704 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] 10.222.0.72 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001734 Aug 04 10:16:52.220132 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 788 bytes} [Thu Aug 4 10:16:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:16:52.224632 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: WARNING keystonemiddleware.auth_token [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:16:52.230558 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: WARNING keystonemiddleware.auth_token [None req-50920805-d316-400d-b3e4-992e1e4c3fb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:16:52.235756 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5633c1af09c0 pid: 103191 (default app) Aug 04 10:18:07.849788 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:07.851045 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Aug 04 10:18:07.851758 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 2/2] 10.222.0.72 () {54 vars in 931 bytes} [Thu Aug 4 10:18:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:18:07.868334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG dbcounter [-] [103191] Writing DB stats nova_api:SELECT=3 {{(pid=103191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:07.869711 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG dbcounter [-] [103191] Writing DB stats nova_cell0:SELECT=3 {{(pid=103191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:07.870896 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG dbcounter [-] [103191] Writing DB stats nova_cell1:SELECT=3 {{(pid=103191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:07.871827 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG dbcounter [-] [103191] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:08.716897 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-e7aa1aab-2a7f-44f6-9fb5-a59ec61200d5 admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:08.749160 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-e7aa1aab-2a7f-44f6-9fb5-a59ec61200d5 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.890611 Aug 04 10:18:08.750192 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 1/3] 10.222.0.72 () {60 vars in 1292 bytes} [Thu Aug 4 10:18:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:18:10.952505 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:10.955697 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-daf525b6-dc47-4007-8c84-4bfc8dc4dedc None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003757 Aug 04 10:18:10.957448 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 3/4] 10.222.0.72 () {54 vars in 931 bytes} [Thu Aug 4 10:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:18:11.415062 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-e84733d5-854f-44e1-b219-d9158be9ed8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:11.435800 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:18:11.435800 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: warnings.warn(msg) Aug 04 10:18:11.464400 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-e84733d5-854f-44e1-b219-d9158be9ed8c admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.501078 Aug 04 10:18:11.465643 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 2/5] 10.222.0.72 () {64 vars in 1283 bytes} [Thu Aug 4 10:18:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:18:11.479762 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG dbcounter [-] [103190] Writing DB stats nova_api:SELECT=3 {{(pid=103190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:11.480596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG dbcounter [-] [103190] Writing DB stats nova_cell0:SELECT=3 {{(pid=103190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:11.481754 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG dbcounter [-] [103190] Writing DB stats nova_cell1:SELECT=3 {{(pid=103190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:11.482465 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG dbcounter [-] [103190] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:11.691818 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-368159d6-e7b5-40d5-aae1-2d76b00f8089 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:11.696377 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:18:11.696377 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: warnings.warn(msg) Aug 04 10:18:11.764250 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-368159d6-e7b5-40d5-aae1-2d76b00f8089 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289650 Aug 04 10:18:11.765118 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 4/6] 10.222.0.72 () {64 vars in 1336 bytes} [Thu Aug 4 10:18:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:18:14.040470 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-e84733d5-854f-44e1-b219-d9158be9ed8c admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:14.041499 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-e84733d5-854f-44e1-b219-d9158be9ed8c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 04 10:18:14.041895 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 3/7] 10.222.0.72 () {54 vars in 931 bytes} [Thu Aug 4 10:18:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:18:14.709179 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-d3361467-121a-442f-9991-e5d3e7a6b071 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:14.728641 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:18:14.728641 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: warnings.warn(msg) Aug 04 10:18:14.748270 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-d3361467-121a-442f-9991-e5d3e7a6b071 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.700165 Aug 04 10:18:14.749074 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 5/8] 10.222.0.72 () {64 vars in 1283 bytes} [Thu Aug 4 10:18:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:18:14.760823 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-55697e72-a1ec-46b7-8c9f-c1a3667ca75b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:14.763621 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:18:14.763621 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: warnings.warn(msg) Aug 04 10:18:14.797401 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-55697e72-a1ec-46b7-8c9f-c1a3667ca75b admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040247 Aug 04 10:18:14.807980 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 4/9] 10.222.0.72 () {64 vars in 1336 bytes} [Thu Aug 4 10:18:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:18:17.072366 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-d3361467-121a-442f-9991-e5d3e7a6b071 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:17.073449 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-d3361467-121a-442f-9991-e5d3e7a6b071 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 04 10:18:17.078383 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 6/10] 10.222.0.72 () {54 vars in 931 bytes} [Thu Aug 4 10:18:17 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:18:17.491420 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-cbac50d0-015b-421e-b7d7-038f066623c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10}} {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:17.510091 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-cbac50d0-015b-421e-b7d7-038f066623c1 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430598 Aug 04 10:18:17.510640 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 5/11] 10.222.0.72 () {64 vars in 1283 bytes} [Thu Aug 4 10:18:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:18:17.523234 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-ebca4ec8-bdbf-4df9-8fac-133d7f874aea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:17.547647 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-ebca4ec8-bdbf-4df9-8fac-133d7f874aea admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028803 Aug 04 10:18:17.548316 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 7/12] 10.222.0.72 () {64 vars in 1336 bytes} [Thu Aug 4 10:18:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:18:19.746530 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-cbac50d0-015b-421e-b7d7-038f066623c1 admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:19.748280 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-cbac50d0-015b-421e-b7d7-038f066623c1 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002172 Aug 04 10:18:19.749316 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 6/13] 10.222.0.72 () {54 vars in 931 bytes} [Thu Aug 4 10:18:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:18:20.202590 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-5079115a-0e02-4655-a8f9-2423e3f8c79c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "name": "ds2G"}} {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:20.227906 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-5079115a-0e02-4655-a8f9-2423e3f8c79c admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.466637 Aug 04 10:18:20.228475 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 8/14] 10.222.0.72 () {64 vars in 1283 bytes} [Thu Aug 4 10:18:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:18:20.241437 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-3b32cf20-439b-4d4d-8be6-3ea5879924a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:20.272737 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-3b32cf20-439b-4d4d-8be6-3ea5879924a1 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035813 Aug 04 10:18:20.276491 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 7/15] 10.222.0.72 () {64 vars in 1336 bytes} [Thu Aug 4 10:18:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:18:22.518993 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-5079115a-0e02-4655-a8f9-2423e3f8c79c admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:22.520570 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-5079115a-0e02-4655-a8f9-2423e3f8c79c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001991 Aug 04 10:18:22.520962 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 9/16] 10.222.0.72 () {54 vars in 931 bytes} [Thu Aug 4 10:18:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:18:22.939418 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-c3922c3c-8042-4a07-a321-0bdd66545b20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "vcpus": 4, "ram": 4096, "swap": 0, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:22.959785 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-c3922c3c-8042-4a07-a321-0bdd66545b20 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433003 Aug 04 10:18:22.960519 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 8/17] 10.222.0.72 () {64 vars in 1283 bytes} [Thu Aug 4 10:18:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:18:22.973210 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-75632e2a-3859-461e-8a3e-a7cacf78f318 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:22.997128 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-75632e2a-3859-461e-8a3e-a7cacf78f318 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028255 Aug 04 10:18:22.998391 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 10/18] 10.222.0.72 () {64 vars in 1336 bytes} [Thu Aug 4 10:18:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:18:25.235854 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-c3922c3c-8042-4a07-a321-0bdd66545b20 admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:25.237393 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-c3922c3c-8042-4a07-a321-0bdd66545b20 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Aug 04 10:18:25.238548 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 9/19] 10.222.0.72 () {54 vars in 931 bytes} [Thu Aug 4 10:18:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:18:25.641600 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-2a0a8af2-3d06-414c-8689-b1f1da997d6f admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:25.666109 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-2a0a8af2-3d06-414c-8689-b1f1da997d6f admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.421311 Aug 04 10:18:25.666667 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 11/20] 10.222.0.72 () {60 vars in 1292 bytes} [Thu Aug 4 10:18:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:18:28.222133 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-c3922c3c-8042-4a07-a321-0bdd66545b20 admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:28.223226 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-c3922c3c-8042-4a07-a321-0bdd66545b20 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 04 10:18:28.223631 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 10/21] 10.222.0.72 () {54 vars in 931 bytes} [Thu Aug 4 10:18:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:18:28.617351 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-62524bc2-0329-4514-9ad1-d662b66e3b24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:28.636099 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-62524bc2-0329-4514-9ad1-d662b66e3b24 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.406379 Aug 04 10:18:28.636643 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 12/22] 10.222.0.72 () {64 vars in 1283 bytes} [Thu Aug 4 10:18:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:18:28.648468 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-cb6a5fed-064c-423e-861e-71f950ddd049 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:28.673008 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-cb6a5fed-064c-423e-861e-71f950ddd049 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028121 Aug 04 10:18:28.673563 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 11/23] 10.222.0.72 () {64 vars in 1333 bytes} [Thu Aug 4 10:18:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:18:30.868438 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-62524bc2-0329-4514-9ad1-d662b66e3b24 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:30.869656 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-62524bc2-0329-4514-9ad1-d662b66e3b24 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Aug 04 10:18:30.870155 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 13/24] 10.222.0.72 () {54 vars in 931 bytes} [Thu Aug 4 10:18:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:18:31.267608 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-5dc71920-87b1-4f08-8c41-3d80b58848a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "2", "ram": 2048, "name": "m1.small"}} {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:31.286887 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-5dc71920-87b1-4f08-8c41-3d80b58848a2 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.410915 Aug 04 10:18:31.287442 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 12/25] 10.222.0.72 () {64 vars in 1283 bytes} [Thu Aug 4 10:18:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:18:31.299310 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-f1d82886-f433-4d10-a4da-e881fddfcc16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:31.323495 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-f1d82886-f433-4d10-a4da-e881fddfcc16 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027864 Aug 04 10:18:31.324219 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 14/26] 10.222.0.72 () {64 vars in 1333 bytes} [Thu Aug 4 10:18:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:18:33.531476 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-5dc71920-87b1-4f08-8c41-3d80b58848a2 admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:33.532605 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-5dc71920-87b1-4f08-8c41-3d80b58848a2 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 04 10:18:33.533022 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 13/27] 10.222.0.72 () {54 vars in 931 bytes} [Thu Aug 4 10:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:18:33.908752 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-0e12a8ab-84e8-40c2-a363-b395d35242d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true, "id": "3", "ram": 4096, "vcpus": 2}} {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:33.929229 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-0e12a8ab-84e8-40c2-a363-b395d35242d9 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.389878 Aug 04 10:18:33.930360 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 15/28] 10.222.0.72 () {64 vars in 1283 bytes} [Thu Aug 4 10:18:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:18:33.943578 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-7d739d0f-3470-41f5-964b-6db7da8c0e26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:33.967091 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-7d739d0f-3470-41f5-964b-6db7da8c0e26 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027436 Aug 04 10:18:33.967788 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 14/29] 10.222.0.72 () {64 vars in 1333 bytes} [Thu Aug 4 10:18:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:18:36.182194 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-0e12a8ab-84e8-40c2-a363-b395d35242d9 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:36.183209 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-0e12a8ab-84e8-40c2-a363-b395d35242d9 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 04 10:18:36.183607 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 16/30] 10.222.0.72 () {54 vars in 931 bytes} [Thu Aug 4 10:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:18:36.619280 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-b28e222c-6722-408c-8fe6-8e2d3b8622ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "swap": 0, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:36.639251 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-b28e222c-6722-408c-8fe6-8e2d3b8622ce admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.449630 Aug 04 10:18:36.639887 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 15/31] 10.222.0.72 () {64 vars in 1283 bytes} [Thu Aug 4 10:18:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:18:36.652305 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-9b0445bb-94ef-4a65-a28f-483d578f5e0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:36.679161 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-9b0445bb-94ef-4a65-a28f-483d578f5e0c admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030362 Aug 04 10:18:36.680019 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 17/32] 10.222.0.72 () {64 vars in 1333 bytes} [Thu Aug 4 10:18:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:18:38.883391 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-b28e222c-6722-408c-8fe6-8e2d3b8622ce admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:38.884508 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-b28e222c-6722-408c-8fe6-8e2d3b8622ce admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Aug 04 10:18:38.885097 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 16/33] 10.222.0.72 () {54 vars in 931 bytes} [Thu Aug 4 10:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:18:39.331896 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-205740f7-1fa5-4c15-9600-4cd9881c71e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "vcpus": 8, "name": "m1.xlarge", "ram": 16384, "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:39.352171 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-205740f7-1fa5-4c15-9600-4cd9881c71e8 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.457032 Aug 04 10:18:39.353014 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 18/34] 10.222.0.72 () {64 vars in 1283 bytes} [Thu Aug 4 10:18:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:18:39.365154 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-faf991a0-f16d-4897-81b2-a2dae948e2f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:18:39.370095 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG dbcounter [-] [103191] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:39.399056 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-faf991a0-f16d-4897-81b2-a2dae948e2f0 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038064 Aug 04 10:18:39.399836 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 17/35] 10.222.0.72 () {64 vars in 1333 bytes} [Thu Aug 4 10:18:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:18:59.471244 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-205740f7-1fa5-4c15-9600-4cd9881c71e8 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:59.472281 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-205740f7-1fa5-4c15-9600-4cd9881c71e8 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 04 10:18:59.472683 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 19/36] 10.222.0.72 () {54 vars in 931 bytes} [Thu Aug 4 10:18:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:18:59.483134 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG dbcounter [-] [103191] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:59.863866 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-02d8bc27-f02a-47a4-a324-3e55f1d56a86 admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:18:59.882332 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-02d8bc27-f02a-47a4-a324-3e55f1d56a86 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403658 Aug 04 10:18:59.882793 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 18/37] 10.222.0.72 () {60 vars in 1292 bytes} [Thu Aug 4 10:18:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:19:00.944596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-205740f7-1fa5-4c15-9600-4cd9881c71e8 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:00.945589 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-205740f7-1fa5-4c15-9600-4cd9881c71e8 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 04 10:19:00.945977 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 20/38] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Aug 4 10:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:19:01.466138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-f456c0cb-df50-4b3e-8e0b-c07ae34a6edb admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:01.472240 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.wsgi [None req-f456c0cb-df50-4b3e-8e0b-c07ae34a6edb admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-f456c0cb-df50-4b3e-8e0b-c07ae34a6edb admin admin] Request method failure captured: Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Accept: application/json Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Accept-Encoding: gzip, deflate Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Connection: keep-alive Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Content-Length: 0 Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Host: 10.222.0.72 Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Openstack-Api-Version: compute 2.90 Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Openstack-System-Scope: None Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: User-Agent: python-novaclient Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Auth-Token: gAAAAABi650UMKa4UWteYn9DXQYqs-0razISKqecqNX2C_Nz9JstVlQOzqeXgfPJXT0wGe9bEj5d50MGDcy5mgilg2HAYGFW2kG3Qpo0CJb6RhyDyX3Sw2Xk2jv30WYxxDTFafP-tDWKBhab44nSX5BF8GOBsrC7pz9L83X6_3nSKleDlqD6Ctc Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Domain-Id: None Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Domain-Name: None Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Identity-Status: Confirmed Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Is-Admin-Project: True Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Project-Domain-Id: default Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Project-Domain-Name: Default Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Project-Id: 8d75901b5a184df7b4b0c986ca5abc96 Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Project-Name: admin Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Role: member,admin,reader Aug 04 10:19:01.475497 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Roles: member,admin,reader Aug 04 10:19:01.477171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:19:01.477171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Tenant: admin Aug 04 10:19:01.477171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Tenant-Id: 8d75901b5a184df7b4b0c986ca5abc96 Aug 04 10:19:01.477171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Tenant-Name: admin Aug 04 10:19:01.477171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User: admin Aug 04 10:19:01.477171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User-Domain-Id: default Aug 04 10:19:01.477171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User-Domain-Name: Default Aug 04 10:19:01.477171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User-Id: bca06f724a4f42d0afd72d25da1e0911 Aug 04 10:19:01.477171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User-Name: admin Aug 04 10:19:01.477171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: method: > Aug 04 10:19:01.477171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: exception: Flavor 42 could not be found. Aug 04 10:19:01.477171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: action_args: {'id': '42'} Aug 04 10:19:01.477171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:19:01.477171 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:19:01.478106 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:01.479223 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-f456c0cb-df50-4b3e-8e0b-c07ae34a6edb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:19:01.480389 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-f456c0cb-df50-4b3e-8e0b-c07ae34a6edb admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.387987 Aug 04 10:19:01.480389 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 19/39] 10.222.0.72 () {60 vars in 1190 bytes} [Thu Aug 4 10:19:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:01.486751 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-2adbf034-ab76-442d-8ef4-660e4a9a803c admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:01.490870 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG dbcounter [-] [103190] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:01.510087 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-2adbf034-ab76-442d-8ef4-660e4a9a803c admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027116 Aug 04 10:19:01.510612 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 21/40] 10.222.0.72 () {60 vars in 1210 bytes} [Thu Aug 4 10:19:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:19:01.520759 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-8f6e040c-1870-472a-849f-37ac91baae16 admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:01.543763 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-8f6e040c-1870-472a-849f-37ac91baae16 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027154 Aug 04 10:19:01.544316 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 20/41] 10.222.0.72 () {60 vars in 1210 bytes} [Thu Aug 4 10:19:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:19:01.553921 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-dac4e830-870a-4c08-8a17-de4e46fe7614 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:01.560181 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.wsgi [None req-dac4e830-870a-4c08-8a17-de4e46fe7614 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-dac4e830-870a-4c08-8a17-de4e46fe7614 admin admin] Request method failure captured: Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Accept: application/json Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Accept-Encoding: gzip, deflate Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Connection: keep-alive Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Content-Length: 0 Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Host: 10.222.0.72 Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Openstack-Api-Version: compute 2.90 Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Openstack-System-Scope: None Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: User-Agent: python-novaclient Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Auth-Token: gAAAAABi650UMKa4UWteYn9DXQYqs-0razISKqecqNX2C_Nz9JstVlQOzqeXgfPJXT0wGe9bEj5d50MGDcy5mgilg2HAYGFW2kG3Qpo0CJb6RhyDyX3Sw2Xk2jv30WYxxDTFafP-tDWKBhab44nSX5BF8GOBsrC7pz9L83X6_3nSKleDlqD6Ctc Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Domain-Id: None Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Domain-Name: None Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Identity-Status: Confirmed Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Is-Admin-Project: True Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Project-Domain-Id: default Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Project-Domain-Name: Default Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Project-Id: 8d75901b5a184df7b4b0c986ca5abc96 Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Project-Name: admin Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Role: member,admin,reader Aug 04 10:19:01.563423 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Roles: member,admin,reader Aug 04 10:19:01.565486 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:19:01.565486 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Tenant: admin Aug 04 10:19:01.565486 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Tenant-Id: 8d75901b5a184df7b4b0c986ca5abc96 Aug 04 10:19:01.565486 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Tenant-Name: admin Aug 04 10:19:01.565486 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User: admin Aug 04 10:19:01.565486 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User-Domain-Id: default Aug 04 10:19:01.565486 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User-Domain-Name: Default Aug 04 10:19:01.565486 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User-Id: bca06f724a4f42d0afd72d25da1e0911 Aug 04 10:19:01.565486 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User-Name: admin Aug 04 10:19:01.565486 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: method: > Aug 04 10:19:01.565486 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: exception: Flavor 42 could not be found. Aug 04 10:19:01.565486 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: action_args: {'id': '42'} Aug 04 10:19:01.565486 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:19:01.565486 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:19:01.566540 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:01.567789 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-dac4e830-870a-4c08-8a17-de4e46fe7614 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:19:01.569053 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-dac4e830-870a-4c08-8a17-de4e46fe7614 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015325 Aug 04 10:19:01.569053 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 22/42] 10.222.0.72 () {60 vars in 1190 bytes} [Thu Aug 4 10:19:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:02.524721 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-8f6e040c-1870-472a-849f-37ac91baae16 admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:02.525738 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-8f6e040c-1870-472a-849f-37ac91baae16 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 04 10:19:02.526134 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 21/43] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Aug 4 10:19:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:19:03.044195 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-ce683472-c6a2-47ce-a09f-8d7853fb0e41 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:03.049563 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.wsgi [None req-ce683472-c6a2-47ce-a09f-8d7853fb0e41 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-ce683472-c6a2-47ce-a09f-8d7853fb0e41 admin admin] Request method failure captured: Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Accept: application/json Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Accept-Encoding: gzip, deflate Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Connection: keep-alive Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Content-Length: 0 Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Host: 10.222.0.72 Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Openstack-Api-Version: compute 2.90 Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Openstack-System-Scope: None Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: User-Agent: python-novaclient Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Auth-Token: gAAAAABi650WOrVIXWhg-1o4Z-PKRwBMQmoMaMLcnQOkWkNSJdxQo2VaoH_JN21QvTPyEh-a09cTz9g7f8RUdBwJwVYYQOgSOZnXPMGPiQEgQ9XX5VPlhtdTfdRW_s8J5sQPEreDYe2GFRSiYx1-Gno_2TLHjrPnw0DlsJzHXj4fDIaqiuMmAB4 Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Domain-Id: None Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Domain-Name: None Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Identity-Status: Confirmed Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Is-Admin-Project: True Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Project-Domain-Id: default Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Project-Domain-Name: Default Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Project-Id: 8d75901b5a184df7b4b0c986ca5abc96 Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Project-Name: admin Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Role: member,admin,reader Aug 04 10:19:03.051037 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Roles: member,admin,reader Aug 04 10:19:03.052596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:19:03.052596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Tenant: admin Aug 04 10:19:03.052596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Tenant-Id: 8d75901b5a184df7b4b0c986ca5abc96 Aug 04 10:19:03.052596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Tenant-Name: admin Aug 04 10:19:03.052596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User: admin Aug 04 10:19:03.052596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User-Domain-Id: default Aug 04 10:19:03.052596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User-Domain-Name: Default Aug 04 10:19:03.052596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User-Id: bca06f724a4f42d0afd72d25da1e0911 Aug 04 10:19:03.052596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User-Name: admin Aug 04 10:19:03.052596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: method: > Aug 04 10:19:03.052596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: exception: Flavor 84 could not be found. Aug 04 10:19:03.052596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: action_args: {'id': '84'} Aug 04 10:19:03.052596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:19:03.052596 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:19:03.053791 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:03.055123 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-ce683472-c6a2-47ce-a09f-8d7853fb0e41 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:19:03.056427 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-ce683472-c6a2-47ce-a09f-8d7853fb0e41 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.387386 Aug 04 10:19:03.056427 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 23/44] 10.222.0.72 () {60 vars in 1190 bytes} [Thu Aug 4 10:19:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:03.062431 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-1446fa80-06c6-4f59-9a75-4d029af24a7e admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:03.077820 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-1446fa80-06c6-4f59-9a75-4d029af24a7e admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018933 Aug 04 10:19:03.078270 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 22/45] 10.222.0.72 () {60 vars in 1210 bytes} [Thu Aug 4 10:19:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:19:03.088331 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-2af7a080-3b1e-4874-a9e7-5cd8ef368bf7 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:03.102848 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-2af7a080-3b1e-4874-a9e7-5cd8ef368bf7 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018001 Aug 04 10:19:03.103355 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 24/46] 10.222.0.72 () {60 vars in 1210 bytes} [Thu Aug 4 10:19:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:19:03.112363 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-04920085-d00a-43f4-8b19-6cc4a6e6673e admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:03.117600 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.wsgi [None req-04920085-d00a-43f4-8b19-6cc4a6e6673e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-04920085-d00a-43f4-8b19-6cc4a6e6673e admin admin] Request method failure captured: Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Accept: application/json Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Accept-Encoding: gzip, deflate Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Connection: keep-alive Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Content-Length: 0 Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Host: 10.222.0.72 Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Openstack-Api-Version: compute 2.90 Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Openstack-System-Scope: None Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: User-Agent: python-novaclient Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Auth-Token: gAAAAABi650WOrVIXWhg-1o4Z-PKRwBMQmoMaMLcnQOkWkNSJdxQo2VaoH_JN21QvTPyEh-a09cTz9g7f8RUdBwJwVYYQOgSOZnXPMGPiQEgQ9XX5VPlhtdTfdRW_s8J5sQPEreDYe2GFRSiYx1-Gno_2TLHjrPnw0DlsJzHXj4fDIaqiuMmAB4 Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Domain-Id: None Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Domain-Name: None Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Identity-Status: Confirmed Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Is-Admin-Project: True Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Project-Domain-Id: default Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Project-Domain-Name: Default Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Project-Id: 8d75901b5a184df7b4b0c986ca5abc96 Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Project-Name: admin Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Role: member,admin,reader Aug 04 10:19:03.119084 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Roles: member,admin,reader Aug 04 10:19:03.120369 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:19:03.120369 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Tenant: admin Aug 04 10:19:03.120369 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Tenant-Id: 8d75901b5a184df7b4b0c986ca5abc96 Aug 04 10:19:03.120369 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Tenant-Name: admin Aug 04 10:19:03.120369 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User: admin Aug 04 10:19:03.120369 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User-Domain-Id: default Aug 04 10:19:03.120369 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User-Domain-Name: Default Aug 04 10:19:03.120369 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User-Id: bca06f724a4f42d0afd72d25da1e0911 Aug 04 10:19:03.120369 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User-Name: admin Aug 04 10:19:03.120369 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: method: > Aug 04 10:19:03.120369 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: exception: Flavor 84 could not be found. Aug 04 10:19:03.120369 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: action_args: {'id': '84'} Aug 04 10:19:03.120369 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:19:03.120369 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:19:03.121138 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:03.122265 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-04920085-d00a-43f4-8b19-6cc4a6e6673e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:19:03.123236 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-04920085-d00a-43f4-8b19-6cc4a6e6673e admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011604 Aug 04 10:19:03.123236 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 23/47] 10.222.0.72 () {60 vars in 1190 bytes} [Thu Aug 4 10:19:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:04.091745 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-2af7a080-3b1e-4874-a9e7-5cd8ef368bf7 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:04.092823 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-2af7a080-3b1e-4874-a9e7-5cd8ef368bf7 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 04 10:19:04.093253 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 25/48] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Aug 4 10:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:19:04.636349 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-d4ba3bf6-c755-4032-bbc7-6262a89f66b7 admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:04.642788 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.wsgi [None req-d4ba3bf6-c755-4032-bbc7-6262a89f66b7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-d4ba3bf6-c755-4032-bbc7-6262a89f66b7 admin admin] Request method failure captured: Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Accept: application/json Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Accept-Encoding: gzip, deflate Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Connection: keep-alive Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Content-Length: 0 Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Host: 10.222.0.72 Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Openstack-Api-Version: compute 2.90 Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Openstack-System-Scope: None Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: User-Agent: python-novaclient Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Auth-Token: gAAAAABi650XRoVNSob0o8mkayLjm0YN4777hvH-mcQEBEK8c-AF9nQCVAGtv7GlL3MRcMbKML-prQt2H9LcY3VgrhWOAwVfA91ueSL6IWoj06wgBM5N-rxINdGV_e8vG4JZIMpKGL33d-wG678CinsOJuXINxl70u0yFDBpyyWgSs2RAA8_tUE Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Domain-Id: None Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Domain-Name: None Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Identity-Status: Confirmed Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Is-Admin-Project: True Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Project-Domain-Id: default Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Project-Domain-Name: Default Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Project-Id: 8d75901b5a184df7b4b0c986ca5abc96 Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Project-Name: admin Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Role: member,admin,reader Aug 04 10:19:04.644301 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Roles: member,admin,reader Aug 04 10:19:04.645791 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:19:04.645791 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Tenant: admin Aug 04 10:19:04.645791 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Tenant-Id: 8d75901b5a184df7b4b0c986ca5abc96 Aug 04 10:19:04.645791 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-Tenant-Name: admin Aug 04 10:19:04.645791 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User: admin Aug 04 10:19:04.645791 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User-Domain-Id: default Aug 04 10:19:04.645791 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User-Domain-Name: Default Aug 04 10:19:04.645791 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User-Id: bca06f724a4f42d0afd72d25da1e0911 Aug 04 10:19:04.645791 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: X-User-Name: admin Aug 04 10:19:04.645791 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: method: > Aug 04 10:19:04.645791 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: exception: Flavor 451 could not be found. Aug 04 10:19:04.645791 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: action_args: {'id': '451'} Aug 04 10:19:04.645791 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:19:04.645791 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:19:04.646801 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: ERROR nova.api.openstack.wsgi Aug 04 10:19:04.648334 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-d4ba3bf6-c755-4032-bbc7-6262a89f66b7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:19:04.649628 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-d4ba3bf6-c755-4032-bbc7-6262a89f66b7 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.411385 Aug 04 10:19:04.649628 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 24/49] 10.222.0.72 () {60 vars in 1193 bytes} [Thu Aug 4 10:19:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:04.655237 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-0a0c23b5-87d3-4fc6-aff7-0ca86817549a admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:04.669768 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-0a0c23b5-87d3-4fc6-aff7-0ca86817549a admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018139 Aug 04 10:19:04.670279 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 26/50] 10.222.0.72 () {60 vars in 1210 bytes} [Thu Aug 4 10:19:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:19:04.680013 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-ede2f233-4cee-498b-b0cd-5f6622d8560f admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:04.694997 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-ede2f233-4cee-498b-b0cd-5f6622d8560f admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018727 Aug 04 10:19:04.695503 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 25/51] 10.222.0.72 () {60 vars in 1210 bytes} [Thu Aug 4 10:19:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:19:04.704329 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-635bbe85-1f99-4c40-81f7-2f171575ce64 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:04.709601 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.wsgi [None req-635bbe85-1f99-4c40-81f7-2f171575ce64 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-635bbe85-1f99-4c40-81f7-2f171575ce64 admin admin] Request method failure captured: Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Accept: application/json Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Accept-Encoding: gzip, deflate Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Connection: keep-alive Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Content-Length: 0 Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Host: 10.222.0.72 Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Openstack-Api-Version: compute 2.90 Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Openstack-System-Scope: None Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: User-Agent: python-novaclient Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Auth-Token: gAAAAABi650XRoVNSob0o8mkayLjm0YN4777hvH-mcQEBEK8c-AF9nQCVAGtv7GlL3MRcMbKML-prQt2H9LcY3VgrhWOAwVfA91ueSL6IWoj06wgBM5N-rxINdGV_e8vG4JZIMpKGL33d-wG678CinsOJuXINxl70u0yFDBpyyWgSs2RAA8_tUE Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Domain-Id: None Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Domain-Name: None Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Identity-Status: Confirmed Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Is-Admin-Project: True Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Project-Domain-Id: default Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Project-Domain-Name: Default Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Project-Id: 8d75901b5a184df7b4b0c986ca5abc96 Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Project-Name: admin Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Role: member,admin,reader Aug 04 10:19:04.711073 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Roles: member,admin,reader Aug 04 10:19:04.712746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8d75901b5a184df7b4b0c986ca5abc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:19:04.712746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Tenant: admin Aug 04 10:19:04.712746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Tenant-Id: 8d75901b5a184df7b4b0c986ca5abc96 Aug 04 10:19:04.712746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-Tenant-Name: admin Aug 04 10:19:04.712746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User: admin Aug 04 10:19:04.712746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User-Domain-Id: default Aug 04 10:19:04.712746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User-Domain-Name: Default Aug 04 10:19:04.712746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User-Id: bca06f724a4f42d0afd72d25da1e0911 Aug 04 10:19:04.712746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: X-User-Name: admin Aug 04 10:19:04.712746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: method: > Aug 04 10:19:04.712746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: exception: Flavor 451 could not be found. Aug 04 10:19:04.712746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: action_args: {'id': '451'} Aug 04 10:19:04.712746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:19:04.712746 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:19:04.713832 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: ERROR nova.api.openstack.wsgi Aug 04 10:19:04.715125 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-635bbe85-1f99-4c40-81f7-2f171575ce64 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:19:04.716454 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-635bbe85-1f99-4c40-81f7-2f171575ce64 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011502 Aug 04 10:19:04.716454 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 27/52] 10.222.0.72 () {60 vars in 1193 bytes} [Thu Aug 4 10:19:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:05.667170 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-ede2f233-4cee-498b-b0cd-5f6622d8560f admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:05.668239 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-ede2f233-4cee-498b-b0cd-5f6622d8560f admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 04 10:19:05.668628 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 26/53] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Aug 4 10:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:19:06.180728 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-a66b928e-0761-4bec-937a-cc8fa3647598 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:19:06.199676 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-a66b928e-0761-4bec-937a-cc8fa3647598 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.394858 Aug 04 10:19:06.200243 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 28/54] 10.222.0.72 () {64 vars in 1235 bytes} [Thu Aug 4 10:19:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:19:07.182873 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-ede2f233-4cee-498b-b0cd-5f6622d8560f admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:07.183881 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-ede2f233-4cee-498b-b0cd-5f6622d8560f admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 04 10:19:07.184308 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 27/55] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Aug 4 10:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:19:07.701187 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-cb395b82-f935-4ebb-bd53-bbe42c8377c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:19:07.720544 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-cb395b82-f935-4ebb-bd53-bbe42c8377c7 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.397636 Aug 04 10:19:07.721147 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 29/56] 10.222.0.72 () {64 vars in 1235 bytes} [Thu Aug 4 10:19:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:19:08.686778 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-ede2f233-4cee-498b-b0cd-5f6622d8560f admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:08.687833 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-ede2f233-4cee-498b-b0cd-5f6622d8560f admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 04 10:19:08.688266 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 28/57] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Aug 4 10:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:19:09.205694 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-5f9ada2b-a784-48d0-920e-f437577ba676 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:19:09.225027 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-5f9ada2b-a784-48d0-920e-f437577ba676 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.399710 Aug 04 10:19:09.225569 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 30/58] 10.222.0.72 () {64 vars in 1235 bytes} [Thu Aug 4 10:19:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:19:10.192566 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-ede2f233-4cee-498b-b0cd-5f6622d8560f admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:10.193598 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-ede2f233-4cee-498b-b0cd-5f6622d8560f admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 04 10:19:10.193981 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 29/59] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Aug 4 10:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:19:10.741441 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-322e0d37-3dae-47ef-a26a-12fb2da6e0af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:19:10.759871 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-322e0d37-3dae-47ef-a26a-12fb2da6e0af admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.430581 Aug 04 10:19:10.760443 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 31/60] 10.222.0.72 () {64 vars in 1235 bytes} [Thu Aug 4 10:19:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:19:11.722496 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-ede2f233-4cee-498b-b0cd-5f6622d8560f admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:11.723537 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-ede2f233-4cee-498b-b0cd-5f6622d8560f admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 04 10:19:11.723936 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 30/61] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Aug 4 10:19:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:19:12.243187 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-72e7e54e-2ec6-417c-a235-795b5e1f47b6 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:19:12.263818 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-72e7e54e-2ec6-417c-a235-795b5e1f47b6 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404464 Aug 04 10:19:12.264388 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 32/62] 10.222.0.72 () {60 vars in 1202 bytes} [Thu Aug 4 10:19:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:20:03.623256 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-ede2f233-4cee-498b-b0cd-5f6622d8560f admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:20:03.624332 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-ede2f233-4cee-498b-b0cd-5f6622d8560f admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002114 Aug 04 10:20:03.624733 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 31/63] 10.222.0.72 () {54 vars in 931 bytes} [Thu Aug 4 10:20:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:20:03.635038 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG dbcounter [-] [103190] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:20:04.020681 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-e307699b-a2fa-42ab-8578-2c56ae446081 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:20:04.040666 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-e307699b-a2fa-42ab-8578-2c56ae446081 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409962 Aug 04 10:20:04.041137 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 33/64] 10.222.0.72 () {60 vars in 1292 bytes} [Thu Aug 4 10:20:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:20:04.064843 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-ff20ff95-1943-46e4-8fc4-d31c7738637c admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:20:04.068266 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG dbcounter [-] [103191] Writing DB stats nova_api:SELECT=14 {{(pid=103191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:20:04.073861 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-ff20ff95-1943-46e4-8fc4-d31c7738637c admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012640 Aug 04 10:20:04.074398 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 32/65] 10.222.0.72 () {60 vars in 1283 bytes} [Thu Aug 4 10:20:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:20:04.086543 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-d6cc3af3-2e1f-452d-8f47-2080ab57f6e4 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:20:04.094238 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-d6cc3af3-2e1f-452d-8f47-2080ab57f6e4 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011306 Aug 04 10:20:04.094745 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 34/66] 10.222.0.72 () {60 vars in 1286 bytes} [Thu Aug 4 10:20:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:20:04.105960 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-bfe5323c-f53d-4545-96cb-8e80558beff7 admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:20:04.113788 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-bfe5323c-f53d-4545-96cb-8e80558beff7 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011405 Aug 04 10:20:04.114294 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 33/67] 10.222.0.72 () {60 vars in 1286 bytes} [Thu Aug 4 10:20:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:20:04.126052 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-d9e6334f-3955-4d26-a0f3-2e2f043867ce admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:20:04.133573 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-d9e6334f-3955-4d26-a0f3-2e2f043867ce admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011621 Aug 04 10:20:04.134078 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 35/68] 10.222.0.72 () {60 vars in 1283 bytes} [Thu Aug 4 10:20:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:23:04.968185 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-bfe5323c-f53d-4545-96cb-8e80558beff7 admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:23:04.969218 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-bfe5323c-f53d-4545-96cb-8e80558beff7 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 04 10:23:04.969607 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 34/69] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Aug 4 10:23:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:23:05.112500 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG dbcounter [-] [103190] Writing DB stats nova_api:SELECT=6 {{(pid=103190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:23:05.271352 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-c3c6ebd8-93cf-4180-94fa-3c3664439fe6 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:23:05.273688 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:23:05.273688 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: warnings.warn(msg) Aug 04 10:23:05.274883 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-c3c6ebd8-93cf-4180-94fa-3c3664439fe6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:23:05.275314 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-c3c6ebd8-93cf-4180-94fa-3c3664439fe6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:23:05.278516 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-c3c6ebd8-93cf-4180-94fa-3c3664439fe6 admin admin] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:23:05.278954 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-c3c6ebd8-93cf-4180-94fa-3c3664439fe6 admin admin] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:23:05.313208 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-c3c6ebd8-93cf-4180-94fa-3c3664439fe6 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.202315 Aug 04 10:23:05.313893 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 36/70] 10.222.0.72 () {60 vars in 1193 bytes} [Thu Aug 4 10:23:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:23:06.146251 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-bfe5323c-f53d-4545-96cb-8e80558beff7 admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:23:06.147250 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-bfe5323c-f53d-4545-96cb-8e80558beff7 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 04 10:23:06.147637 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 35/71] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Aug 4 10:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:23:06.338219 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-41f898be-7d33-4c63-ba1d-23490234b342 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:23:06.340741 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:23:06.340741 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: warnings.warn(msg) Aug 04 10:23:06.341917 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-41f898be-7d33-4c63-ba1d-23490234b342 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:23:06.342352 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-41f898be-7d33-4c63-ba1d-23490234b342 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:23:06.343160 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-41f898be-7d33-4c63-ba1d-23490234b342 admin admin] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:23:06.343582 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-41f898be-7d33-4c63-ba1d-23490234b342 admin admin] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:23:06.362674 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-41f898be-7d33-4c63-ba1d-23490234b342 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075290 Aug 04 10:23:06.363149 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 37/72] 10.222.0.72 () {60 vars in 1193 bytes} [Thu Aug 4 10:23:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:23:17.577357 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-bfe5323c-f53d-4545-96cb-8e80558beff7 admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:23:17.578352 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-bfe5323c-f53d-4545-96cb-8e80558beff7 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 04 10:23:17.578770 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 36/73] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Aug 4 10:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:23:17.721027 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG dbcounter [-] [103190] Writing DB stats nova_cell0:SELECT=4 {{(pid=103190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:23:17.721748 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG dbcounter [-] [103190] Writing DB stats nova_cell1:SELECT=4 {{(pid=103190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:23:17.722360 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG dbcounter [-] [103190] Writing DB stats nova_api:SELECT=8 {{(pid=103190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:23:17.773229 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-1992116e-028a-4bce-a24c-56f13c4b986e admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:23:17.775603 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:23:17.775603 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: warnings.warn(msg) Aug 04 10:23:17.776809 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-1992116e-028a-4bce-a24c-56f13c4b986e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:23:17.777246 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-1992116e-028a-4bce-a24c-56f13c4b986e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:23:17.778021 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-1992116e-028a-4bce-a24c-56f13c4b986e admin admin] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:23:17.778441 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-1992116e-028a-4bce-a24c-56f13c4b986e admin admin] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:23:17.803384 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-1992116e-028a-4bce-a24c-56f13c4b986e admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086576 Aug 04 10:23:17.803868 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 38/74] 10.222.0.72 () {60 vars in 1193 bytes} [Thu Aug 4 10:23:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:23:18.630519 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: DEBUG nova.api.openstack.wsgi [None req-bfe5323c-f53d-4545-96cb-8e80558beff7 admin admin] Calling method '>' {{(pid=103191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:23:18.631532 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: INFO nova.api.openstack.requestlog [None req-bfe5323c-f53d-4545-96cb-8e80558beff7 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 04 10:23:18.631925 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: [pid: 103191|app: 0|req: 37/75] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Aug 4 10:23:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:23:18.820140 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG nova.api.openstack.wsgi [None req-75a45108-cb55-4da7-96cd-34a9ae76c8c4 admin admin] Calling method '>' {{(pid=103190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:23:18.822522 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:23:18.822522 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: warnings.warn(msg) Aug 04 10:23:18.823700 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-75a45108-cb55-4da7-96cd-34a9ae76c8c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:23:18.824180 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-75a45108-cb55-4da7-96cd-34a9ae76c8c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:23:18.824956 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-75a45108-cb55-4da7-96cd-34a9ae76c8c4 admin admin] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:23:18.825379 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: DEBUG oslo_concurrency.lockutils [None req-75a45108-cb55-4da7-96cd-34a9ae76c8c4 admin admin] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:23:18.846383 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: INFO nova.api.openstack.requestlog [None req-75a45108-cb55-4da7-96cd-34a9ae76c8c4 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076696 Aug 04 10:23:18.846861 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: [pid: 103190|app: 0|req: 39/76] 10.222.0.72 () {60 vars in 1193 bytes} [Thu Aug 4 10:23:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:24:18.782934 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: Thu Aug 4 10:24:18 2022 - graceful shutdown triggered... Aug 04 10:24:18.783184 dv-cinder-826608-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 10:24:18.783857 dv-cinder-826608-8-iscsi devstack@n-api.service[103190]: Gracefully killing worker 1 (pid: 103190)... Aug 04 10:24:18.784255 dv-cinder-826608-8-iscsi devstack@n-api.service[103191]: Gracefully killing worker 2 (pid: 103191)... Aug 04 10:24:19.784083 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: worker 1 buried after 1 seconds Aug 04 10:24:19.784672 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: worker 2 buried after 1 seconds Aug 04 10:24:19.784672 dv-cinder-826608-8-iscsi devstack@n-api.service[103189]: goodbye to uWSGI. Aug 04 10:24:19.785677 dv-cinder-826608-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 04 10:24:19.786547 dv-cinder-826608-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 10:24:19.790586 dv-cinder-826608-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 10:24:19.804328 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 10:24:19.806351 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 10:24:19 2022] *** Aug 04 10:24:19.806351 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 10:24:19.806351 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 10:24:19.806351 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: nodename: dv-cinder-826608-8-iscsi Aug 04 10:24:19.806351 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: machine: x86_64 Aug 04 10:24:19.806351 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: clock source: unix Aug 04 10:24:19.806351 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: pcre jit disabled Aug 04 10:24:19.806351 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: detected number of CPU cores: 4 Aug 04 10:24:19.806351 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: current working directory: / Aug 04 10:24:19.806351 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: detected binary path: /usr/bin/uwsgi-core Aug 04 10:24:19.806351 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: your processes number limit is 47680 Aug 04 10:24:19.806351 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: your memory page size is 4096 bytes Aug 04 10:24:19.806351 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: detected max file descriptor number: 2048 Aug 04 10:24:19.806351 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: lock engine: pthread robust mutexes Aug 04 10:24:19.807264 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: thunder lock: enabled Aug 04 10:24:19.807264 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 10:24:19.807264 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 10:24:19.847332 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: Python main interpreter initialized at 0x559dad77c9c0 Aug 04 10:24:19.847332 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: python threads support enabled Aug 04 10:24:19.847332 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: your server socket listen backlog is limited to 100 connections Aug 04 10:24:19.847332 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: your mercy for graceful operations on workers is 90 seconds Aug 04 10:24:19.847793 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 10:24:19.847793 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: *** Operational MODE: preforking *** Aug 04 10:24:19.848057 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: *** uWSGI is running in multiple interpreter mode *** Aug 04 10:24:19.848057 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: spawned uWSGI master process (pid: 117653) Aug 04 10:24:19.848270 dv-cinder-826608-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 10:24:19.849044 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: spawned uWSGI worker 1 (pid: 117666, cores: 1) Aug 04 10:24:19.849175 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: spawned uWSGI worker 2 (pid: 117667, cores: 1) Aug 04 10:24:19.849339 dv-cinder-826608-8-iscsi devstack@n-api.service[117653]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 10:24:20.516850 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 10:24:20.520846 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 10:24:21.666839 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:24:21.666839 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: from cryptography.utils import int_from_bytes Aug 04 10:24:21.667452 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:24:21.667452 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: from cryptography.utils import int_from_bytes Aug 04 10:24:21.697266 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:24:21.697266 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: from cryptography.utils import int_from_bytes Aug 04 10:24:21.697834 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:24:21.697834 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: from cryptography.utils import int_from_bytes Aug 04 10:24:23.988659 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 10:24:23.989225 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 10:24:23.989512 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 10:24:23.989810 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 10:24:23.990072 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 10:24:23.990463 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.990797 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.991125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.991447 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.991786 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.992144 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.992470 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.992991 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.993335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.993601 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.993926 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.994672 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-8-iscsi {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.994672 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.994859 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.995175 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.995502 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.995814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.996165 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.996477 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.996989 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.997434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.997745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.998063 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.998421 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.998723 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.999038 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.999366 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:23.999679 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.000031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.000349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.000756 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-8-iscsi {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.001081 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.001922 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.002240 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.002664 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.002979 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.003293 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.003619 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.003947 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.004284 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.004627 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.004952 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.005280 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.005606 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.005916 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.006227 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.006540 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.006862 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.007172 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.007481 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.007734 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.008082 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.008397 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.008721 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.009047 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.009303 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.009554 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.009880 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.010199 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.010512 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.010823 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.011133 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.011443 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.011750 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.012287 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.012824 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.013144 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.013472 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.013800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.014124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.014441 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.014784 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.015179 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020734 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020734 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020734 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020734 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020734 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020734 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020734 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.020734 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.021239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.021239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.021493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.021976 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.022439 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.022909 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.023397 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.023716 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.024069 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.024390 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.024704 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.025018 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.025355 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.025655 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.025978 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.026306 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.026620 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.026931 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.027243 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.027553 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.027879 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.028218 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.028530 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.028860 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.029174 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.029483 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.029802 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.030120 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.030422 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.030750 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.031058 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.031365 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.032021 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.032320 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.032673 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.032934 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.033269 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.033601 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.034116 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.034438 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.034804 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.035102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.035440 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.035885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.036106 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.036599 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.037132 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.037484 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.037844 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.038237 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.038570 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.039071 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.039305 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.039656 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.040016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.040343 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.040668 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.041005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.041330 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.041655 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.041978 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.042309 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.042634 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.042983 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.043301 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.043626 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.043995 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.044299 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.044625 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.044961 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.045293 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.045613 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.045963 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.046315 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.046701 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.047275 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.047542 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.047865 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.048303 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.048625 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.048970 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.049302 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.049622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.049952 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.050288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.050601 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.050906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.051225 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.051543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.051884 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.052236 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.052558 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.052875 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.053199 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.053519 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.053832 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.054149 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.054463 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.054773 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.055081 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.055431 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.055715 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.056065 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.056404 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.056718 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.057060 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.057386 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.057687 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.058004 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.058326 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.058634 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.058949 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.059265 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.059574 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.059902 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.060247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.060556 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.061360 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.061360 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.061727 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.061895 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.062209 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.062418 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.062735 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.063053 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.063385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.064238 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.064561 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.064905 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.065245 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.065557 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.065895 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.066230 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.066551 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.066866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.067184 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.067584 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.067789 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.068132 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.068439 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.068753 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.069063 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.069374 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.069686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.069993 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.070322 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.070642 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.070953 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.071261 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.071571 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.071923 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.072106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 10:24:24.072595 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.072768 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 10:24:24.072928 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.073090 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 10:24:24.073245 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.073391 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 10:24:24.073543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.073705 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 10:24:24.073871 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.074019 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.074164 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.074315 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.074462 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.074605 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.074757 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.074948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.075098 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.075243 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.075386 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.075576 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.075773 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.075922 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.076130 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.076281 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.076705 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.076893 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.077054 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.077244 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.077596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.077790 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.077948 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.078104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-8-iscsi {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.078259 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.078417 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.078562 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.078706 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.078941 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.079107 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.079260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.079997 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.080165 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.080312 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.080472 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.080662 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.080819 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.080972 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.081117 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.081260 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.081435 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.081582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.081733 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.081897 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.082044 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.082187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.082341 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.082486 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.082630 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.082782 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.082937 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.083166 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.083314 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.083456 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.083601 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.083825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.084016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.084180 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.084339 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.084500 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.084656 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.084656 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.084930 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-8-iscsi {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.085083 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.085228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.085379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.085524 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.085677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.085864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.086045 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.086192 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.086336 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.086504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.086971 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.087127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.087287 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.087433 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.088634 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.088799 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.088965 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.089193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.089359 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.089527 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.089681 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.089884 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.090046 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.090203 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.090369 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.090522 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.090713 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.090866 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.091020 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.091181 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.091335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.091499 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.091644 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.091867 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.092052 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.092215 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.092373 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.092527 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.092683 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.092836 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.092990 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.093149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.093301 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.093453 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.093616 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.093778 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.093970 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.094123 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.094123 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.094408 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.094560 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.094708 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.094860 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.095049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.095205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.095370 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.095516 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.095670 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.095823 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.095993 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.096146 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.096302 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.096454 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.096608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.097115 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.097271 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.097424 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.097570 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.097957 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.098133 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.098282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.098427 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.098570 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.098722 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.098722 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.099009 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.099173 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.099399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.099558 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.099704 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.099895 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.100098 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.100245 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.100390 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.100533 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.100688 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.100886 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.101036 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.101188 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.101341 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.101487 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.101638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.101796 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.101943 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.102097 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.102241 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.102392 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.102545 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.102702 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.102847 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.102991 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.103135 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.103287 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.103442 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.103586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.103747 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.103911 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.104122 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.104268 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.104430 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.104585 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.104730 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.104730 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.105016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.105160 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.105316 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.105462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.105462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.105753 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.105915 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.106060 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.106218 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.106370 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.106522 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.106673 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.106843 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.107325 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.107489 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.107645 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.107815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.108285 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.108459 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.108632 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.108781 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.108940 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.109085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.109244 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.109408 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.109628 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.109787 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.110069 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.110253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.110411 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.110584 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.110743 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.110946 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.111103 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.111337 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.111493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.111639 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.111782 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.111935 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.112143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.112301 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.112446 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.112597 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.112756 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.112903 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.113058 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.113202 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.113346 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.114296 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.114469 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.114627 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.114782 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.114948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.115223 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.115498 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.115676 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.115837 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.116037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.116190 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.116335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.116499 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.116644 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.116788 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.116939 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.117103 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.117561 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.117719 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.117719 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.117993 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.118370 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.118538 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.118686 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.118840 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.118994 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.119150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.119297 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.119442 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.119601 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.119828 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.120026 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.120180 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.120325 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.120480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.120645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.120792 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.120978 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.121131 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.121276 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.121429 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.121587 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.121741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.121893 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.122046 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.122202 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.122403 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.122568 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:24:24.122725 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.122870 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.123014 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.123157 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.123309 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.123472 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.123622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.123777 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.123929 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.124125 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.124293 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.124448 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.124611 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.124764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.124909 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.124909 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.125222 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.125448 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.125608 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.125761 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.125906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.126088 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.126773 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.126929 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.127080 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.127266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.127673 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.127848 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.128040 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.128211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.128590 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.128759 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.128957 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.129129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.129290 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.129448 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.129600 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.129752 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.130001 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.130171 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.130324 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.130475 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.130642 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.130881 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.131093 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.131261 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.131431 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.131592 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.131755 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.131907 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.132134 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.132303 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.132464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.132624 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.132786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.132937 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.133096 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.133255 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.133406 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.133606 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.133759 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.133916 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.134086 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.134249 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.134409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.134571 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.134731 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.134893 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.135055 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.135214 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.135365 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.135604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.135604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.135906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.136109 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.136263 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.136434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.136585 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.136735 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.136894 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.137047 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.137205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.137362 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.137540 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.137878 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.138144 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.138303 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.138707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.138882 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.139055 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.139216 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.139378 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.139539 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.139699 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.139858 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.140148 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.140314 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.140483 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.140483 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.140770 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.140929 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.141143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.141315 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.141475 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.141627 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.141829 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.142000 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.142192 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.142365 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.142518 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.142676 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.142836 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.142987 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.143145 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.143328 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.143481 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.143641 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.143792 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.144007 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.144179 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.144409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.144563 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.144714 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.144864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.145023 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.145188 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.145347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.145519 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.145757 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.145915 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.146075 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.146235 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.146397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.146564 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.146716 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.146873 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.147032 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.147197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.147349 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.147508 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.147680 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.148052 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.148333 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.148501 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.148885 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.149049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.149202 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.149354 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.149520 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.149674 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.149832 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.149983 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.150142 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.150394 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.150563 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.150718 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.150870 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.151030 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.151223 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.151382 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.151547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.151708 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.151859 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.152740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.152935 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.153117 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.153282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.153443 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.153595 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.153762 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.153919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.154085 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.154247 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.154406 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.154609 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.154771 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.154925 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.155086 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.155256 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.155417 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.155578 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.155578 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.155988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.156213 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.156379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.156531 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.156681 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.156832 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.156994 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.157147 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.157306 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.158150 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.158370 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.158535 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.158644 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.158734 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.158836 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.159091 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.159231 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.159362 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.159486 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.159607 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.159721 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.159831 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.159949 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.160101 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.160228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.160366 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.160555 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.160672 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.160791 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.160915 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.161036 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.161158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.161338 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.161469 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.161590 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.161713 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.161833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.161946 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.162057 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.162178 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.162291 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.162410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.162523 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.162641 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.162762 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.162874 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.162984 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.163104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.163218 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.163328 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.163448 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.163568 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.163568 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.163814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.163937 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.164076 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.164219 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.164306 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.164393 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.164475 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.164555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.164629 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.164708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.164789 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.164874 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.164948 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.165026 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.165098 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.165169 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.165239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.165382 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.165471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.165543 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.165623 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.165695 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.165766 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.165878 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.166043 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.166138 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.166214 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.166293 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.166374 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.166456 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.166540 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.166540 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.166540 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.166540 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.166805 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.166886 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.166981 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.167055 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.167125 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.167194 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.167320 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.167403 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.167476 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.167547 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.167625 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.167703 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.167784 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.167857 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.167935 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.168931 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.169251 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.169424 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.169575 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.169721 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.169872 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.170019 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.170171 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.170327 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.170493 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.170738 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.171054 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.171322 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.171522 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.171691 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.171844 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.172295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.172450 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.172602 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.172749 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.172902 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.173108 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.173775 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.173938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.174090 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.174261 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.174426 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.174578 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.174737 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.174737 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.175024 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.175184 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.175184 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.175484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.175646 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.175646 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.175943 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.176235 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.176235 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.176536 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.176688 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.176840 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.176991 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.176991 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.177295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.177447 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.177447 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.177769 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.177932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.177932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.178384 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.178646 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.178646 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.178950 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.179118 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.179118 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.179565 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.179729 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.179729 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.180063 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.180244 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.180244 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.180542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.180722 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.180722 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.181087 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.181248 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.181248 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.181586 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.181743 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.181743 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.182049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.182203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.182366 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.182524 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.182524 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.182819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.182979 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.182979 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.183274 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.183433 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.183433 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.183726 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.183979 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.183979 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.184317 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.184473 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.184473 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.184767 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.184933 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.184933 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.185221 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.185372 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.185372 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.185665 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.185825 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.185825 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.186120 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.186284 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.186284 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.186578 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.186730 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.186881 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.187032 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.187032 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.187316 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.187476 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.187664 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.187827 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.187827 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.188178 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.188543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.188543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.188990 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.189143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.189143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.189590 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.189765 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.190004 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.190177 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.190368 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.190526 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.190526 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.190837 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.191078 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.191078 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.191372 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.191533 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.191732 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.191900 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.191900 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.192228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.192380 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.192380 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.192680 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.192832 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.192832 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.193156 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.193309 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.193309 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.193610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.193763 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.193763 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.194047 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.194213 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.194213 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.194213 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.194657 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.194822 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.194822 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.195116 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.195278 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.195278 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.195573 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.195726 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.195726 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.196084 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.196256 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.196256 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.196545 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.196707 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.196707 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.197002 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.197166 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.197319 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.197478 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.197637 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.197797 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.197963 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.198116 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.198279 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.198574 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.198764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.199024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.199191 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.199191 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.199478 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.199787 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.199976 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.200149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.200310 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.200462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.200622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.200809 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.201159 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.201332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.201485 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.201674 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.201836 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.201999 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.202151 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.202302 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.202466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.202619 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.202770 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.202936 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.203089 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.203239 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.203413 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.203573 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.203725 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.203890 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.204123 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.204312 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.204506 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.204670 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.204670 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.204976 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.205136 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.205296 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.205447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.205684 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.205847 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.205999 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.206158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.206311 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.206461 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.206622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.206781 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.206933 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.207091 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.207245 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.207409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.207579 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.207732 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.207897 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.208075 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.208238 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.208400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.208686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.208857 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.209037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.209288 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.209447 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.209609 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.210044 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.210231 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.210389 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.210557 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.210719 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.210872 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.211023 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.211191 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.211423 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.211589 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.211800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.211996 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.212156 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.212319 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.212484 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.212636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.212795 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.212955 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.213107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.213259 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.213418 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.213571 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.213731 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.213884 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.214055 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.214849 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.215018 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.215173 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.215331 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.215510 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.215776 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.215967 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.216129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.216280 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.216430 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.216582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.216746 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.216900 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.217067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.217235 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.217396 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.217564 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.217718 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.217879 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.218040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.218192 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.218350 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.218522 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.218842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.219006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.219166 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.219453 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.219622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.219789 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.220807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.220979 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.221133 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.221291 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.221541 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.221718 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.221931 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.222099 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.222099 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.222463 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.222635 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.222797 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.222951 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.222951 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.223257 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.223410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.223576 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.223737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.223737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.224060 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.224214 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.224377 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.224550 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.224712 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.224883 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.225044 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.225198 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.225349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.225514 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.225668 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.225819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.225969 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.226122 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.226287 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.226448 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.226611 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.226770 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.226932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.227085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.227251 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.227405 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.227557 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.227970 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.228089 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.228180 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.228277 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.228373 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.228461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.228547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.228632 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.228717 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.228829 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.229170 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.229287 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.229393 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.229556 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.229658 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.229754 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.229843 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.229929 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.230022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.230109 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.230205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.230294 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.230380 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.230474 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.230571 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.230658 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.230792 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.230882 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.230976 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.231078 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.231290 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.231388 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.231510 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.231658 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.231750 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.231845 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.231995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.232108 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.232209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.232298 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.232433 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.232573 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.232931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.233036 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.233036 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.233036 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.233266 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.233353 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.233489 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.233595 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.233685 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.233779 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.233876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.233963 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.234059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.234155 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.234243 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.234329 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.234415 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.234509 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.234676 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.234778 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.234882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.234959 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.235045 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.235130 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.235231 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.235231 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.235399 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.235493 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.235638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.236347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.236525 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.236671 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.236671 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.236898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.236898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.237127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.237127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.237337 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.237502 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.237631 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.237747 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.237874 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.237988 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.238100 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.238212 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.238331 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.238444 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.238565 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.238565 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.238785 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.238899 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.239031 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.239230 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.239367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.239483 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.239604 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.239717 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.239837 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.239995 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.240128 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.240243 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.240363 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.240477 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.240618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.240760 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.240902 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.241036 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.241168 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.241312 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.241533 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.241681 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.241820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.241952 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.242133 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.242272 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.242412 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.242553 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.242694 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.242849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.243100 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.243236 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.243378 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.243519 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.243651 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.243779 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.243894 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.244043 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.244177 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.244292 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.244413 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.244535 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.244657 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.244777 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.244913 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.245036 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.245149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.245267 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.245387 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.245514 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.245638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.245751 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.245751 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.245977 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.246098 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.246225 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.246339 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.246459 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.246573 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.246684 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.246795 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.246920 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.247060 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.247192 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.247322 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.247459 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.247598 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.247744 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.247876 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.248086 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.248233 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.248394 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.248537 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.248669 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.248799 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.248931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.249060 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.249207 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.249207 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.249518 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.249518 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.249774 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.249774 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.250599 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.250743 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.250843 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.250843 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.251008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.251103 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.251229 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.251327 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.251422 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.251581 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.251716 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.251862 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.252011 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.252192 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.252336 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.252477 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.252609 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.252786 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.252887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.252986 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.253091 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.253177 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.253388 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.253497 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.253588 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.253674 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.253804 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.253959 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.254112 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.254428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.254760 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.255074 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.255203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.255383 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.255525 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.255692 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.255813 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.256062 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.256223 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.256370 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.256530 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.256685 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.256838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.256984 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.257136 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.257308 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.257469 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.257624 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.257778 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 10:24:24.257878 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.258203 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.258518 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.258826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.259133 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.259443 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.259792 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.260133 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.260460 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.260801 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.261138 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.261458 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.261792 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.262123 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.262442 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.262765 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.263099 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.263412 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.263720 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.264148 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.264392 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.264667 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.264975 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.265302 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.265597 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.265905 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.266213 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.266540 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.266878 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.267206 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.267518 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.267826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.268158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.268470 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.268821 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.269130 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.269468 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.269781 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.270110 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.270431 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.270751 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.271068 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.271384 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.271704 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.272047 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.272366 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.272681 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.273010 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.273324 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.273645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.274235 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.274569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.274888 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.275208 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.275525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.275843 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.276189 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.276509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.276826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.277142 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.277459 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.277797 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.278123 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.278454 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.278797 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.279122 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.279442 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.279764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.280133 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.280502 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.280825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.281138 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.281456 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.281776 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.282097 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.282933 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.283268 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.283597 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.283916 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.284261 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.284575 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.284893 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.285211 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.285543 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.285886 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.286211 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.286539 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.286846 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.287166 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.287752 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.288103 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.288449 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.288784 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.289117 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.289530 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.290115 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.290678 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.291227 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.291794 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.292426 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.293007 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.293612 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.294211 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.294814 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.295415 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.296060 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.296650 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.298004 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.299200 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.299815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.300470 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.301084 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.301692 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.302297 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.302901 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.303508 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.304142 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.304758 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.305350 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.305942 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.306515 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.307129 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.307733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.308332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.308846 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.309179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.309750 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.310327 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.310925 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.311513 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.312138 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.312752 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.313335 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.313958 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.314548 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.315156 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.315752 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.316372 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.316956 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.317547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.318137 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.318487 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.318816 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.319173 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.319501 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.319885 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.320256 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.320583 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.320919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.321245 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.321569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.321933 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.322262 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.322868 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.323210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.323546 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.323897 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.324269 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.324581 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.324896 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.325209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.325542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.325864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.326184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.326504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.326822 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.327140 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.327457 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.327775 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.328125 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.328446 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.328762 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.329078 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.329456 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.329771 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.330086 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.330413 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.330767 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.331096 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.331420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.331741 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.332088 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.332407 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.332720 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.333035 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.333353 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.333674 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.334013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.334546 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.335095 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.335881 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.336498 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.337075 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.337652 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.338208 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.338790 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.339368 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.339930 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.340523 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.341081 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.341672 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.342300 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.342895 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.343496 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.344065 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.344570 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.345595 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.345927 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.346264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.346587 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.346982 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.347490 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.348045 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.348369 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.348687 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.349001 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.349312 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.349653 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.349965 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.350275 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.350586 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.350897 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.351205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.351512 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.351829 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.352168 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.352483 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.352794 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.353107 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.353414 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.353758 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.354183 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.354424 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.354754 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.355073 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.355400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.355713 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.356064 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.356394 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.356719 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.357033 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.357372 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.357689 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.358004 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.358369 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.358635 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.358950 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.359264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.359601 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.359932 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.360267 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.361176 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.361512 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.361841 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.362163 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.362481 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.362815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.363198 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.363747 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.364307 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.364823 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.365331 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.365845 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.366348 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.366858 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.367371 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.367888 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.368271 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.368615 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.368941 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.369317 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.369656 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.370015 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.370489 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.371038 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.371425 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.371755 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.372106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.372459 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:24:24.372713 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 10:24:24.423931 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO dbcounter [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] Registered counter for database nova_api Aug 04 10:24:24.444619 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:24:24.451645 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writer thread running {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:24:24.508897 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.context [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),393fd0ff-f1f5-4df3-b996-afcdc2a85538(cell1) {{(pid=117666) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 10:24:24.513003 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:24:24.515054 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:24:24.515858 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:24:24.518402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:24:24.520410 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO dbcounter [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] Registered counter for database nova_cell0 Aug 04 10:24:24.521822 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO dbcounter [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] Registered counter for database nova_api Aug 04 10:24:24.524436 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO dbcounter [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] Registered counter for database nova_cell1 Aug 04 10:24:24.531822 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:24:24.533645 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:24:24.539257 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writer thread running {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:24:24.541489 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_db.sqlalchemy.engines [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117667) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:24:24.544537 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writer thread running {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:24:24.548765 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writer thread running {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:24:24.605577 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.context [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),393fd0ff-f1f5-4df3-b996-afcdc2a85538(cell1) {{(pid=117667) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 10:24:24.609771 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:24:24.611355 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:24:24.612183 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:24:24.614174 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:24:24.616219 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO dbcounter [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] Registered counter for database nova_cell0 Aug 04 10:24:24.620248 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO dbcounter [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] Registered counter for database nova_cell1 Aug 04 10:24:24.627601 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_db.sqlalchemy.engines [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117667) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:24:24.628934 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_db.sqlalchemy.engines [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117667) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:24:24.635309 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writer thread running {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:24:24.637433 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writer thread running {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:24:24.689482 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO dbcounter [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] Registered counter for database nova_cell0 Aug 04 10:24:24.696077 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:24:24.700448 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writer thread running {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:24:24.793394 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO dbcounter [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] Registered counter for database nova_cell0 Aug 04 10:24:24.801252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_db.sqlalchemy.engines [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117667) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:24:24.806123 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writer thread running {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:24:25.026325 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: WARNING keystonemiddleware.auth_token [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:24:25.033790 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: WARNING keystonemiddleware.auth_token [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:24:25.128663 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: WARNING keystonemiddleware.auth_token [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:24:25.136092 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: WARNING keystonemiddleware.auth_token [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:24:25.383700 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: WARNING keystonemiddleware.auth_token [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:24:25.390516 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: WARNING keystonemiddleware.auth_token [None req-0a9202b2-296f-4839-a2d1-9c416d9869ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:24:25.397169 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559dad77c9c0 pid: 117666 (default app) Aug 04 10:24:25.481098 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: WARNING keystonemiddleware.auth_token [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:24:25.487306 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: WARNING keystonemiddleware.auth_token [None req-4947b29e-5ab4-421c-bf2c-755c4f693ac1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:24:25.493647 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559dad77c9c0 pid: 117667 (default app) Aug 04 10:24:59.069322 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:24:59.070599 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:24:59.072701 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:24:59.073731 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:00.032229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-73a7d193-9094-46d9-aad1-a1100ba798ba tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Action: 'create', calling method: .version_select at 0x7fbaa6fefd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-291426237"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:00.170926 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=3 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:00.172328 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=3 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:00.173937 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=3 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:00.174643 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=3 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:01.257760 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0a27463d-b7a6-4fee-9f28-b07d4def4a76 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] Action: 'create', calling method: .version_select at 0x7fbaa6fefd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2026670657", "metadata": {"Type": "work"}}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:01.495810 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-73a7d193-9094-46d9-aad1-a1100ba798ba tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.443693 Aug 04 10:25:01.496743 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 1/1] 10.222.0.72 () {60 vars in 1155 bytes} [Thu Aug 4 10:24:59 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2447 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 10:25:01.513073 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2bf27647-2120-40ca-b8a2-5cadfd4dbd08 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6e47b80>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:01.616577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2bf27647-2120-40ca-b8a2-5cadfd4dbd08 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a" status: 200 len: 344 microversion: 2.1 time: 0.108874 Aug 04 10:25:01.617444 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 2/2] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:25:01 2022] GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a => generated 344 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:02.546580 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0a27463d-b7a6-4fee-9f28-b07d4def4a76 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.380058 Aug 04 10:25:02.548811 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 1/3] 10.222.0.72 () {60 vars in 1156 bytes} [Thu Aug 4 10:25:00 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2384 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 04 10:25:02.562471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-27db49ed-c664-4236-8657-dca4fb964090 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] Calling method '.version_select at 0x7fbaa6e61280>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:02.631121 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ecc397a3-a639-406d-bfdc-02020c35bb48 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6ebcb80>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:02.657898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-27db49ed-c664-4236-8657-dca4fb964090 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd" status: 200 len: 353 microversion: 2.1 time: 0.099422 Aug 04 10:25:02.658597 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 3/4] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:25:02 2022] GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:02.735042 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ecc397a3-a639-406d-bfdc-02020c35bb48 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a" status: 200 len: 345 microversion: 2.1 time: 0.108514 Aug 04 10:25:02.735634 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 2/5] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:25:02 2022] GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:25:02.748932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8c847202-be2a-4887-96b8-99862550f921 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Action: 'create', calling method: .version_select at 0x7fbaa6e61940>, body: {"snapshot": {"volume_id": "23e236c5-532f-40b1-8a51-5f47889d471a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-284955724"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:03.139638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8c847202-be2a-4887-96b8-99862550f921 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.392081 Aug 04 10:25:03.143906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 4/6] 10.222.0.72 () {60 vars in 1162 bytes} [Thu Aug 4 10:25:02 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:03.154443 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d6a959f9-ceff-4ece-a3e0-c330769d629a tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6e60310>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:03.224529 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d6a959f9-ceff-4ece-a3e0-c330769d629a tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b" status: 200 len: 286 microversion: 2.1 time: 0.073639 Aug 04 10:25:03.231863 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 3/7] 10.222.0.72 () {58 vars in 1251 bytes} [Thu Aug 4 10:25:03 2022] GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:03.237059 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-03b46e59-2dac-4011-97a3-62f7d7d21507 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6e61d30>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:03.311581 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-03b46e59-2dac-4011-97a3-62f7d7d21507 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.079036 Aug 04 10:25:03.313591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 5/8] 10.222.0.72 () {58 vars in 1140 bytes} [Thu Aug 4 10:25:03 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:03.325965 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5ee725f8-91f3-42ad-ae63-effd43603bb5 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6e60a60>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:03.375609 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5ee725f8-91f3-42ad-ae63-effd43603bb5 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b" status: 200 len: 286 microversion: 2.1 time: 0.053130 Aug 04 10:25:03.376875 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 4/9] 10.222.0.72 () {58 vars in 1251 bytes} [Thu Aug 4 10:25:03 2022] GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:03.671796 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4a392cae-dd53-48b4-aa76-104881ee75ab tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] Calling method '.version_select at 0x7fbaa6e47af0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:03.728366 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4a392cae-dd53-48b4-aa76-104881ee75ab tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd" status: 200 len: 354 microversion: 2.1 time: 0.060214 Aug 04 10:25:03.731266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 6/10] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:25:03 2022] GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:03.743071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-3f26aac2-d232-4fd8-9118-7aff6ae49e5f tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] Calling method '.version_select at 0x7fbaa6ebcd30>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:03.963141 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-3f26aac2-d232-4fd8-9118-7aff6ae49e5f tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd" status: 200 len: 354 microversion: 2.1 time: 0.223804 Aug 04 10:25:03.983918 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 5/11] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:25:03 2022] GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd => generated 354 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:03.985848 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c43b749b-df5d-4618-a71f-81975427ae5e tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] Calling method '.version_select at 0x7fbaa6e68550>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:04.148572 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c43b749b-df5d-4618-a71f-81975427ae5e tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd" status: 202 len: 0 microversion: 2.1 time: 0.167927 Aug 04 10:25:04.157346 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 7/12] 10.222.0.72 () {58 vars in 1248 bytes} [Thu Aug 4 10:25:03 2022] DELETE /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:25:04.158452 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0ab2cfc2-fadc-4068-90e5-86efde174d06 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] Calling method '.version_select at 0x7fbaa6e60af0>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:04.226328 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0ab2cfc2-fadc-4068-90e5-86efde174d06 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd" status: 200 len: 353 microversion: 2.1 time: 0.072408 Aug 04 10:25:04.233859 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 6/13] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:25:04 2022] GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:04.390689 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-dfaa7ab3-f8ce-4f84-bfc7-fb2ccc0dba97 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6e47c10>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:04.661815 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-dfaa7ab3-f8ce-4f84-bfc7-fb2ccc0dba97 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b" status: 200 len: 286 microversion: 2.1 time: 0.276271 Aug 04 10:25:04.662499 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 8/14] 10.222.0.72 () {58 vars in 1251 bytes} [Thu Aug 4 10:25:04 2022] GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b => generated 286 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:05.242087 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e60ea621-410e-480a-a52a-b6a660bc1884 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] Calling method '.version_select at 0x7fbaa6e60310>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:05.302556 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e60ea621-410e-480a-a52a-b6a660bc1884 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd" status: 200 len: 353 microversion: 2.1 time: 0.065360 Aug 04 10:25:05.303564 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 7/15] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:25:05 2022] GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:05.675716 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0e91833a-0fa9-459d-82f5-d81f220923de tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6e61160>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:05.733861 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0e91833a-0fa9-459d-82f5-d81f220923de tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b" status: 200 len: 286 microversion: 2.1 time: 0.063080 Aug 04 10:25:05.734963 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 9/16] 10.222.0.72 () {58 vars in 1251 bytes} [Thu Aug 4 10:25:05 2022] GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:06.338657 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4516de98-b844-4483-97fb-3c4fd5aa36f3 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] Calling method '.version_select at 0x7fbaa6e600d0>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:06.445526 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4516de98-b844-4483-97fb-3c4fd5aa36f3 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd" status: 200 len: 353 microversion: 2.1 time: 0.133211 Aug 04 10:25:06.463558 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 8/17] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:25:06 2022] GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd => generated 353 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:06.748575 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d0b08b23-5f53-40ad-a99e-cf9bdbe1ed29 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6e61af0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:06.847096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d0b08b23-5f53-40ad-a99e-cf9bdbe1ed29 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b" status: 200 len: 287 microversion: 2.1 time: 0.104147 Aug 04 10:25:06.850165 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 10/18] 10.222.0.72 () {58 vars in 1251 bytes} [Thu Aug 4 10:25:06 2022] GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:06.873394 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a4e37693-8e9b-4f0b-9269-0032dffa8762 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6e609d0>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:07.053075 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a4e37693-8e9b-4f0b-9269-0032dffa8762 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "DELETE /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b" status: 202 len: 0 microversion: 2.1 time: 0.195508 Aug 04 10:25:07.053979 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 9/19] 10.222.0.72 () {58 vars in 1254 bytes} [Thu Aug 4 10:25:06 2022] DELETE /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:25:07.062247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d8b902e0-4d3a-48c4-98c1-077f079034b2 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6e47d30>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:07.163406 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d8b902e0-4d3a-48c4-98c1-077f079034b2 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b" status: 200 len: 286 microversion: 2.1 time: 0.055642 Aug 04 10:25:07.163406 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 11/20] 10.222.0.72 () {58 vars in 1251 bytes} [Thu Aug 4 10:25:07 2022] GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:07.465920 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a69d724e-56ba-4cb0-9cc8-8194e949f199 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] Calling method '.version_select at 0x7fbaa6ebca60>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:07.550687 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-a69d724e-56ba-4cb0-9cc8-8194e949f199 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] HTTP exception thrown: Volume 6608adab-86de-4ac6-a3c8-dd43618d24cd could not be found. Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a69d724e-56ba-4cb0-9cc8-8194e949f199 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] Request method failure captured: Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd HTTP/1.1 Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi6558-8ydFpcJrdNmWXGD17YTnigBrgpYntdSFTih7ZhwFJUnBfR5ReNnSeblpALRr6C_ZT8BwBcD31ed3_sVbuvgDgug5cOHwg1MLiXYIdoOhXI38_121s_SgNlhl3XIAo9NqHEnQ6vTBDVCTcBIYFcR96v8mqV7JgsRzObmiP9yaTM Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 9134c9d38f1f4b5b9a592a0669e1ad73 Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-VolumesGetTestJSON-1321263387 Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:25:07.563209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:25:07.564294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9134c9d38f1f4b5b9a592a0669e1ad73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9134c9d38f1f4b5b9a592a0669e1ad73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9134c9d38f1f4b5b9a592a0669e1ad73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9134c9d38f1f4b5b9a592a0669e1ad73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:25:07.564294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-VolumesGetTestJSON-1321263387 Aug 04 10:25:07.564294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 9134c9d38f1f4b5b9a592a0669e1ad73 Aug 04 10:25:07.564294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-VolumesGetTestJSON-1321263387 Aug 04 10:25:07.564294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-VolumesGetTestJSON-1321263387-project Aug 04 10:25:07.564294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:25:07.564294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:25:07.564294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: 1bf691162d004bec8ce6894e59b05df8 Aug 04 10:25:07.564294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-VolumesGetTestJSON-1321263387-project Aug 04 10:25:07.564294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: Aug 04 10:25:07.564294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Volume 6608adab-86de-4ac6-a3c8-dd43618d24cd could not be found. Aug 04 10:25:07.564294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '6608adab-86de-4ac6-a3c8-dd43618d24cd'} Aug 04 10:25:07.564294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6608adab-86de-4ac6-a3c8-dd43618d24cd could not be found. (HTTP 404) (Request-ID: req-79d9d3d3-875a-4e60-88a9-645b41ce5672) Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:07.564919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:25:07.565864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6608adab-86de-4ac6-a3c8-dd43618d24cd could not be found. Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 10:25:07.566690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:25:07.567592 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6608adab-86de-4ac6-a3c8-dd43618d24cd could not be found. Aug 04 10:25:07.567592 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:07.567592 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:07.567592 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:07.567592 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:07.567592 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:25:07.567592 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:25:07.567592 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:25:07.567592 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:25:07.567592 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6608adab-86de-4ac6-a3c8-dd43618d24cd could not be found. Aug 04 10:25:07.567592 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:07.576922 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a69d724e-56ba-4cb0-9cc8-8194e949f199 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] Returning 404 to user: Volume 6608adab-86de-4ac6-a3c8-dd43618d24cd could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:25:07.592399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a69d724e-56ba-4cb0-9cc8-8194e949f199 tempest-VolumesGetTestJSON-1321263387 tempest-VolumesGetTestJSON-1321263387-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd" status: 404 len: 109 microversion: 2.1 time: 0.122564 Aug 04 10:25:07.596056 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 10/21] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:25:07 2022] GET /compute/v2.1/os-volumes/6608adab-86de-4ac6-a3c8-dd43618d24cd => generated 109 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:25:08.137651 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ca8a1346-3b98-4358-91f2-7ebeeef2fe1c tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6e61a60>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:08.186967 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-ca8a1346-3b98-4358-91f2-7ebeeef2fe1c tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] HTTP exception thrown: Snapshot bc03358b-9143-4d38-bea8-6b07b68c003b could not be found. Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ca8a1346-3b98-4358-91f2-7ebeeef2fe1c tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Request method failure captured: Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b HTTP/1.1 Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi6556y8AKlvMjDLWDvr_dTR6qF1GvU1ujj1tpj3C7Ptle3DJGEkFC4dX2H2pORcfhg0iqvS2qPEhJlUIi8_QJH-8sOOF97YTYk60qkb48Xraaj56hZy13z_IKqDAQtV1sw8B4gGQQAi2DeLLDWxT_PA9_YNmjfBYy82pU2BQMxpxwvZQ Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 9467bbafb0ea449dbc1c0b50fd0819e1 Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-569616938 Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:25:08.194855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:25:08.197866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:25:08.197866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesSnapshotsTestJSON-569616938 Aug 04 10:25:08.197866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 9467bbafb0ea449dbc1c0b50fd0819e1 Aug 04 10:25:08.197866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-569616938 Aug 04 10:25:08.197866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesSnapshotsTestJSON-569616938-project Aug 04 10:25:08.197866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:25:08.197866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:25:08.197866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: 7fa64eabc9a746a68d4fbd72053a6aa6 Aug 04 10:25:08.197866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesSnapshotsTestJSON-569616938-project Aug 04 10:25:08.197866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: Aug 04 10:25:08.197866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Snapshot bc03358b-9143-4d38-bea8-6b07b68c003b could not be found. Aug 04 10:25:08.197866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': 'bc03358b-9143-4d38-bea8-6b07b68c003b'} Aug 04 10:25:08.197866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bc03358b-9143-4d38-bea8-6b07b68c003b could not be found. (HTTP 404) (Request-ID: req-961e7e72-cdf8-4fdd-9f9b-8d8204d2880f) Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:25:08.198838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:25:08.199686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bc03358b-9143-4d38-bea8-6b07b68c003b could not be found. Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 10:25:08.201005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:25:08.201890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bc03358b-9143-4d38-bea8-6b07b68c003b could not be found. Aug 04 10:25:08.201890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:25:08.201890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:08.201890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:25:08.201890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:08.201890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:25:08.201890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:25:08.201890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:25:08.201890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:25:08.201890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bc03358b-9143-4d38-bea8-6b07b68c003b could not be found. Aug 04 10:25:08.201890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:25:08.217276 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ca8a1346-3b98-4358-91f2-7ebeeef2fe1c tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Returning 404 to user: Snapshot bc03358b-9143-4d38-bea8-6b07b68c003b could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:25:08.244474 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ca8a1346-3b98-4358-91f2-7ebeeef2fe1c tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b" status: 404 len: 111 microversion: 2.1 time: 0.122211 Aug 04 10:25:08.252282 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 12/22] 10.222.0.72 () {58 vars in 1251 bytes} [Thu Aug 4 10:25:08 2022] GET /compute/v2.1/os-snapshots/bc03358b-9143-4d38-bea8-6b07b68c003b => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:25:08.264523 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-08e0191a-7eb8-456e-8a31-895a668e8038 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6dcf550>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:08.494378 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-08e0191a-7eb8-456e-8a31-895a668e8038 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a" status: 202 len: 0 microversion: 2.1 time: 0.237432 Aug 04 10:25:08.498352 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 11/23] 10.222.0.72 () {58 vars in 1248 bytes} [Thu Aug 4 10:25:08 2022] DELETE /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:25:08.507577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1be6468f-b530-4bbf-bbd5-40d3450c5077 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6e685e0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:08.657278 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1be6468f-b530-4bbf-bbd5-40d3450c5077 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a" status: 200 len: 344 microversion: 2.1 time: 0.156657 Aug 04 10:25:08.657965 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 13/24] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:25:08 2022] GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a => generated 344 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:09.676112 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-051dc0fa-9ca6-4198-a808-6d71442fc415 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6dcfc10>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:09.853403 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-051dc0fa-9ca6-4198-a808-6d71442fc415 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a" status: 200 len: 344 microversion: 2.1 time: 0.183690 Aug 04 10:25:09.859938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 12/25] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:25:09 2022] GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a => generated 344 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:10.868886 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9c9d7409-fc65-49b3-8ffa-d13e53ee9224 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6e68c10>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:10.973373 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9c9d7409-fc65-49b3-8ffa-d13e53ee9224 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a" status: 200 len: 344 microversion: 2.1 time: 0.109379 Aug 04 10:25:10.980538 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 14/26] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:25:10 2022] GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a => generated 344 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:11.987295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8be39cbe-3790-4bb2-ab8b-837581bf5048 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6dcf9d0>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:12.037236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-8be39cbe-3790-4bb2-ab8b-837581bf5048 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] HTTP exception thrown: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8be39cbe-3790-4bb2-ab8b-837581bf5048 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Request method failure captured: Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a HTTP/1.1 Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi6556y8AKlvMjDLWDvr_dTR6qF1GvU1ujj1tpj3C7Ptle3DJGEkFC4dX2H2pORcfhg0iqvS2qPEhJlUIi8_QJH-8sOOF97YTYk60qkb48Xraaj56hZy13z_IKqDAQtV1sw8B4gGQQAi2DeLLDWxT_PA9_YNmjfBYy82pU2BQMxpxwvZQ Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 9467bbafb0ea449dbc1c0b50fd0819e1 Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-569616938 Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:25:12.039326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:25:12.040555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:25:12.040555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-VolumesSnapshotsTestJSON-569616938 Aug 04 10:25:12.040555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 9467bbafb0ea449dbc1c0b50fd0819e1 Aug 04 10:25:12.040555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-569616938 Aug 04 10:25:12.040555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-VolumesSnapshotsTestJSON-569616938-project Aug 04 10:25:12.040555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:25:12.040555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:25:12.040555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: 7fa64eabc9a746a68d4fbd72053a6aa6 Aug 04 10:25:12.040555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-VolumesSnapshotsTestJSON-569616938-project Aug 04 10:25:12.040555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: Aug 04 10:25:12.040555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.040555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '23e236c5-532f-40b1-8a51-5f47889d471a'} Aug 04 10:25:12.040555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. (HTTP 404) (Request-ID: req-48954219-f6e9-4709-aa65-4274e9abd623) Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:12.041186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:25:12.042071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 10:25:12.043521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:25:12.044437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.044437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.044437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:12.044437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.044437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:12.044437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:25:12.044437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:25:12.044437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:25:12.044437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:25:12.044437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.044437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.044437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8be39cbe-3790-4bb2-ab8b-837581bf5048 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Returning 404 to user: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:25:12.044437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8be39cbe-3790-4bb2-ab8b-837581bf5048 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a" status: 404 len: 109 microversion: 2.1 time: 0.058223 Aug 04 10:25:12.051175 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 13/27] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:25:11 2022] GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:25:12.055972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b9ff58b8-e1e1-4ef3-8143-9fe37784fcd7 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6dcf280>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:12.119022 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-b9ff58b8-e1e1-4ef3-8143-9fe37784fcd7 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] HTTP exception thrown: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b9ff58b8-e1e1-4ef3-8143-9fe37784fcd7 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Request method failure captured: Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a HTTP/1.1 Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi6556y8AKlvMjDLWDvr_dTR6qF1GvU1ujj1tpj3C7Ptle3DJGEkFC4dX2H2pORcfhg0iqvS2qPEhJlUIi8_QJH-8sOOF97YTYk60qkb48Xraaj56hZy13z_IKqDAQtV1sw8B4gGQQAi2DeLLDWxT_PA9_YNmjfBYy82pU2BQMxpxwvZQ Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 9467bbafb0ea449dbc1c0b50fd0819e1 Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-569616938 Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:25:12.123466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:25:12.127096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:25:12.127096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesSnapshotsTestJSON-569616938 Aug 04 10:25:12.127096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 9467bbafb0ea449dbc1c0b50fd0819e1 Aug 04 10:25:12.127096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-569616938 Aug 04 10:25:12.127096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesSnapshotsTestJSON-569616938-project Aug 04 10:25:12.127096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:25:12.127096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:25:12.127096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: 7fa64eabc9a746a68d4fbd72053a6aa6 Aug 04 10:25:12.127096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesSnapshotsTestJSON-569616938-project Aug 04 10:25:12.127096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: Aug 04 10:25:12.127096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.127096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '23e236c5-532f-40b1-8a51-5f47889d471a'} Aug 04 10:25:12.127096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. (HTTP 404) (Request-ID: req-31de716c-69a1-41e2-bd85-485b46e8503e) Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:12.127767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 10:25:12.128898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 10:25:12.129936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:25:12.130904 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.130904 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.130904 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:12.130904 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.130904 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:12.130904 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:25:12.130904 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:25:12.130904 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:25:12.130904 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:25:12.130904 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.130904 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.130904 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b9ff58b8-e1e1-4ef3-8143-9fe37784fcd7 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Returning 404 to user: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:25:12.132472 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b9ff58b8-e1e1-4ef3-8143-9fe37784fcd7 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a" status: 404 len: 109 microversion: 2.1 time: 0.073620 Aug 04 10:25:12.136451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 15/28] 10.222.0.72 () {58 vars in 1248 bytes} [Thu Aug 4 10:25:12 2022] DELETE /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:25:12.142002 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7c42ea18-d548-4d62-a4bf-f7c42ec195b9 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Calling method '.version_select at 0x7fbaa6dcf430>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:12.190451 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-7c42ea18-d548-4d62-a4bf-f7c42ec195b9 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] HTTP exception thrown: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7c42ea18-d548-4d62-a4bf-f7c42ec195b9 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Request method failure captured: Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a HTTP/1.1 Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi6556y8AKlvMjDLWDvr_dTR6qF1GvU1ujj1tpj3C7Ptle3DJGEkFC4dX2H2pORcfhg0iqvS2qPEhJlUIi8_QJH-8sOOF97YTYk60qkb48Xraaj56hZy13z_IKqDAQtV1sw8B4gGQQAi2DeLLDWxT_PA9_YNmjfBYy82pU2BQMxpxwvZQ Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 9467bbafb0ea449dbc1c0b50fd0819e1 Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-569616938 Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:25:12.191882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:25:12.193410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9467bbafb0ea449dbc1c0b50fd0819e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:25:12.193410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-VolumesSnapshotsTestJSON-569616938 Aug 04 10:25:12.193410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 9467bbafb0ea449dbc1c0b50fd0819e1 Aug 04 10:25:12.193410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-569616938 Aug 04 10:25:12.193410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-VolumesSnapshotsTestJSON-569616938-project Aug 04 10:25:12.193410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:25:12.193410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:25:12.193410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: 7fa64eabc9a746a68d4fbd72053a6aa6 Aug 04 10:25:12.193410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-VolumesSnapshotsTestJSON-569616938-project Aug 04 10:25:12.193410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: Aug 04 10:25:12.193410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.193410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '23e236c5-532f-40b1-8a51-5f47889d471a'} Aug 04 10:25:12.193410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. (HTTP 404) (Request-ID: req-55ed2c65-5719-460b-8b5a-710a6cfd5e56) Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:12.194400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:25:12.195826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 10:25:12.197013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:25:12.198465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.198465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.198465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:25:12.198465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.198465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:25:12.198465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:25:12.198465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:25:12.198465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:25:12.198465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:25:12.198465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. Aug 04 10:25:12.198465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:25:12.198465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7c42ea18-d548-4d62-a4bf-f7c42ec195b9 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] Returning 404 to user: Volume 23e236c5-532f-40b1-8a51-5f47889d471a could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:25:12.200242 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7c42ea18-d548-4d62-a4bf-f7c42ec195b9 tempest-VolumesSnapshotsTestJSON-569616938 tempest-VolumesSnapshotsTestJSON-569616938-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a" status: 404 len: 109 microversion: 2.1 time: 0.060156 Aug 04 10:25:12.200242 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 14/29] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:25:12 2022] GET /compute/v2.1/os-volumes/23e236c5-532f-40b1-8a51-5f47889d471a => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:25:15.322292 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-508019183", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:15.550741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] validate_networks() for [('a595c269-03f2-49b6-9865-e02addf09c72', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:25:16.168886 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f15574e3-260e-4943-a1db-bf0e5b2c64a7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Action: 'create', calling method: .version_select at 0x7fbaa6dcf1f0>, body: {"keypair": {"name": "tempest-keypair-952418968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS16jor+14gh+iHbnjHn11HqZPThRPi/Gbq9IMXlW1X3wSbdPUuU3CtjWINKmREvOBkwhjc8bY6LZc+uRzdPwTVBbM3JubZDftsgrFtehu5tgxS9dbvxmRiTl6XWlOQYg=="}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:16.333543 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-f15574e3-260e-4943-a1db-bf0e5b2c64a7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Getting quotas for project 888ab157217942abaf98b99e8eb827de. Resources: {'key_pairs'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:25:16.347319 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-f15574e3-260e-4943-a1db-bf0e5b2c64a7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Getting quotas for user 0ac9aa3a8d7a4383b9211cbac185a325 and project 888ab157217942abaf98b99e8eb827de. Resources: {'key_pairs'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:25:16.522085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f15574e3-260e-4943-a1db-bf0e5b2c64a7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.855849 Aug 04 10:25:16.527668 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 15/30] 10.222.0.72 () {60 vars in 1159 bytes} [Thu Aug 4 10:25:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:25:17.891767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:25:17.892615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:25:17.893113 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:25:17.894137 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:25:17.894137 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:25:17.941532 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:17.942482 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:17.946632 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:17.947536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:18.097954 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Getting quotas for project 2a801dbffe56474d96c2abea31fd2fdc. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:25:18.122690 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Getting quotas for user 84b748f30ebc4c5aa2af6ddcd86037cd and project 2a801dbffe56474d96c2abea31fd2fdc. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:25:18.168718 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:25:18.174235 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:25:18.344441 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b4909228-d91d-48c4-b34d-563fdff3ec4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.455605 Aug 04 10:25:18.354970 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 16/31] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:25:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 3478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:25:18.373879 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6a26a7d0-7c10-44f1-92f8-58a0f5bd9ffe tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:18.375746 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6a26a7d0-7c10-44f1-92f8-58a0f5bd9ffe tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:18.662580 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6a26a7d0-7c10-44f1-92f8-58a0f5bd9ffe tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:18.710808 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6a26a7d0-7c10-44f1-92f8-58a0f5bd9ffe tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1221 microversion: 2.1 time: 0.346322 Aug 04 10:25:18.716066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 16/32] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:18 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1221 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:18.971445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1328423111", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:19.094984 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] validate_networks() for [('a595c269-03f2-49b6-9865-e02addf09c72', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:25:20.482212 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:25:20.482866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:25:20.483091 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:25:20.483676 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:25:20.484328 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:25:20.500697 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:20.502720 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:20.503725 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:20.510316 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:20.543236 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Getting quotas for project 2a801dbffe56474d96c2abea31fd2fdc. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:25:20.558881 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Getting quotas for user 84b748f30ebc4c5aa2af6ddcd86037cd and project 2a801dbffe56474d96c2abea31fd2fdc. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:25:20.582586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:25:20.585268 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:25:20.724407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-669c92e1-6999-4bc5-ba2f-b909154dc765 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.757666 Aug 04 10:25:20.727011 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 17/33] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:25:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:25:20.739030 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d1f5240e-e04b-40d9-90c3-f0f6ec01e7bb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:20.741288 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-d1f5240e-e04b-40d9-90c3-f0f6ec01e7bb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:21.020042 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d1f5240e-e04b-40d9-90c3-f0f6ec01e7bb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:21.041507 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d1f5240e-e04b-40d9-90c3-f0f6ec01e7bb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1222 microversion: 2.1 time: 0.307008 Aug 04 10:25:21.045377 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 17/34] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:20 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1222 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:22.065294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c128c6aa-4796-4e33-9bd7-073934c1967d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:22.066221 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c128c6aa-4796-4e33-9bd7-073934c1967d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:22.259779 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1680415508", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "networks": [{"uuid": "3491383f-0e2e-4dd4-82d9-1a24e1adeef6"}]}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:22.490381 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] validate_networks() for [('3491383f-0e2e-4dd4-82d9-1a24e1adeef6', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:25:22.581153 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c128c6aa-4796-4e33-9bd7-073934c1967d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:22.596603 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c128c6aa-4796-4e33-9bd7-073934c1967d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1222 microversion: 2.1 time: 0.535354 Aug 04 10:25:22.604200 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 18/35] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:22 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1222 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:22.663499 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-385167812", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1871b80-9570-42a3-943d-f71bd233c50d"}], "security_groups": [{"name": "tempest-securitygroup--146768071"}], "key_name": "tempest-keypair-952418968", "user_data": "}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:23.573341 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.network.neutron [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] validate_networks() for [('a1871b80-9570-42a3-943d-f71bd233c50d', None, None, None, None, None)] {{(pid=117667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:25:25.927558 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:25:25.928188 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:25:25.928640 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:25:25.929331 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:25:25.929974 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:25:25.961988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:25.962817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:25.968834 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:25.972329 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:26.094271 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Getting quotas for project e48cfdacb9c44bdd9fe7df95ee93f65b. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:25:26.116111 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Getting quotas for user 532df9b1c22b4b0c9237bb0a36044c7b and project e48cfdacb9c44bdd9fe7df95ee93f65b. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:25:26.171119 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:25:26.176484 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:25:26.406650 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-019cfdbd-805b-47f2-b790-1dc41dcf4c31 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.525268 Aug 04 10:25:26.407333 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 18/36] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:25:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:25:27.915802 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d8bd4122-6d28-47e6-b3e1-527c025b1fca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Action: 'create', calling method: .version_select at 0x7fbaa64ef9d0>, body: {"keypair": {"name": "tempest-keypair-2001758252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrXOKbHSsndnJcI7Vm9PbuqTcohTpnjU2kAgBtwDijFpto9+HEtYPSQPAYhjPxg3xiijKD5Q/KyZTQvH4wYQ9sK1b2+HkPXxcgk117CpcwRfyA7+a7C+InY1Me/50MUtg=="}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:27.971226 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-d8bd4122-6d28-47e6-b3e1-527c025b1fca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Getting quotas for project 35576cef915b41419fc74b0beea0f988. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:25:27.991511 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-d8bd4122-6d28-47e6-b3e1-527c025b1fca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Getting quotas for user 7213149649d249f2b2da3d6c7dac0a68 and project 35576cef915b41419fc74b0beea0f988. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:25:28.085853 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d8bd4122-6d28-47e6-b3e1-527c025b1fca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.675633 Aug 04 10:25:28.095626 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 19/37] 10.222.0.72 () {62 vars in 1200 bytes} [Thu Aug 4 10:25:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1688 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 10:25:28.951060 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d9e3abe4-f4e0-4988-945e-5ddc60db82dc tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Action: 'create', calling method: .version_select at 0x7fbaa64efa60>, body: {"keypair": {"name": "tempest-keypair-398068509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAF4SVq6sgcaZic3xVbuhTTdXqRuhEpU5iFfcKN5D8AaUs42L/mjCM7QEGTlnn+doyOw+nQCUr97eNhCMKMTW1157R49c6+HjrcHbAxZCncg03jWElsuFQhB2zwSkkXvPQ=="}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:28.993619 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-d9e3abe4-f4e0-4988-945e-5ddc60db82dc tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:25:29.019013 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-d9e3abe4-f4e0-4988-945e-5ddc60db82dc tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for user b680411b142642b7acc3585d2481f880 and project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:25:29.102456 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d9e3abe4-f4e0-4988-945e-5ddc60db82dc tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.000052 Aug 04 10:25:29.118750 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 20/38] 10.222.0.72 () {60 vars in 1159 bytes} [Thu Aug 4 10:25:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:29.131721 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2e961128-6bd9-4c45-aaf5-5c6e6880dc74 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:29.134694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2e961128-6bd9-4c45-aaf5-5c6e6880dc74 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:29.170626 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e961128-6bd9-4c45-aaf5-5c6e6880dc74 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:29.171683 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e961128-6bd9-4c45-aaf5-5c6e6880dc74 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:29.172764 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e961128-6bd9-4c45-aaf5-5c6e6880dc74 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:29.173195 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e961128-6bd9-4c45-aaf5-5c6e6880dc74 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:31.120616 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2e961128-6bd9-4c45-aaf5-5c6e6880dc74 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:31.175507 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2e961128-6bd9-4c45-aaf5-5c6e6880dc74 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1322 microversion: 2.1 time: 2.055181 Aug 04 10:25:31.176143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 21/39] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:29 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1322 bytes in 2057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:31.203102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-de832b0f-018a-4082-aeb3-5cc0478d2b2c tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:31.209247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-de832b0f-018a-4082-aeb3-5cc0478d2b2c tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:31.231559 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de832b0f-018a-4082-aeb3-5cc0478d2b2c tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:31.234400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de832b0f-018a-4082-aeb3-5cc0478d2b2c tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:31.236749 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de832b0f-018a-4082-aeb3-5cc0478d2b2c tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:31.237699 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de832b0f-018a-4082-aeb3-5cc0478d2b2c tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:31.269124 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Flavor limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:25:31.270273 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Image limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:25:31.270977 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Flavor pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:25:31.271552 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Image pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:25:31.272243 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:25:31.316416 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:31.324682 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:31.325711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:31.326152 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:31.425323 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Getting quotas for project 888ab157217942abaf98b99e8eb827de. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:25:31.449748 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Getting quotas for user 0ac9aa3a8d7a4383b9211cbac185a325 and project 888ab157217942abaf98b99e8eb827de. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:25:31.519551 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Going to run 1 instances... {{(pid=117667) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:25:31.539260 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:25:31.742695 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-cce7680b-89b4-4414-b17f-770a618fb782 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 9.086022 Aug 04 10:25:31.747313 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 19/40] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:25:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 9092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:25:31.768972 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b6f70932-151e-4c68-aba5-fce1c0348d32 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:31.770233 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b6f70932-151e-4c68-aba5-fce1c0348d32 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:32.007181 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-de832b0f-018a-4082-aeb3-5cc0478d2b2c tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:32.024787 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-de832b0f-018a-4082-aeb3-5cc0478d2b2c tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1273 microversion: 2.1 time: 0.838797 Aug 04 10:25:32.027724 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 22/41] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:31 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1273 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:32.199037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-04f25f94-66ff-457a-9920-6d719db10c9d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:32.199751 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-04f25f94-66ff-457a-9920-6d719db10c9d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:32.223504 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04f25f94-66ff-457a-9920-6d719db10c9d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:32.229318 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04f25f94-66ff-457a-9920-6d719db10c9d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:32.238351 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04f25f94-66ff-457a-9920-6d719db10c9d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:32.240507 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04f25f94-66ff-457a-9920-6d719db10c9d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:32.778090 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b6f70932-151e-4c68-aba5-fce1c0348d32 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:32.799507 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b6f70932-151e-4c68-aba5-fce1c0348d32 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1236 microversion: 2.1 time: 1.037688 Aug 04 10:25:32.822804 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 20/42] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:31 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1236 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:33.176505 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-f1f5411d-702f-4b21-9b59-7db7a4b52c15 req-5de18e36-d52e-4b8b-be57-443af3d6a6ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef5108fd-663e-4c6a-bab7-2c706a4b0ebe", "tag": "82ef3eba-27a2-4b68-aaaa-c836e1bc348b"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:33.200589 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-f1f5411d-702f-4b21-9b59-7db7a4b52c15 req-5de18e36-d52e-4b8b-be57-443af3d6a6ea service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:33.201875 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-f1f5411d-702f-4b21-9b59-7db7a4b52c15 req-5de18e36-d52e-4b8b-be57-443af3d6a6ea service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:33.328328 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-f1f5411d-702f-4b21-9b59-7db7a4b52c15 req-5de18e36-d52e-4b8b-be57-443af3d6a6ea service nova] Creating event network-changed:82ef3eba-27a2-4b68-aaaa-c836e1bc348b for instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe on hv-cinder-82660 Aug 04 10:25:33.349478 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-f1f5411d-702f-4b21-9b59-7db7a4b52c15 req-5de18e36-d52e-4b8b-be57-443af3d6a6ea service nova] Acquired lock "compute-rpcapi-router" {{(pid=117667) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 10:25:33.354719 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-59f7c3ab-d455-4d1a-9c0a-831c12dae882 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:33.359969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-59f7c3ab-d455-4d1a-9c0a-831c12dae882 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:33.364325 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-59f7c3ab-d455-4d1a-9c0a-831c12dae882 None None] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:33.365002 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-59f7c3ab-d455-4d1a-9c0a-831c12dae882 None None] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:33.428829 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.compute.rpcapi [None req-59f7c3ab-d455-4d1a-9c0a-831c12dae882 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 10:25:33.431860 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-59f7c3ab-d455-4d1a-9c0a-831c12dae882 None None] Releasing lock "compute-rpcapi-router" {{(pid=117667) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 10:25:33.513011 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-59f7c3ab-d455-4d1a-9c0a-831c12dae882 None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.698097 Aug 04 10:25:33.514549 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 21/43] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:33.520556 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-00e7f95c-0dee-496b-942f-6e85ce0cf39a tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:33.521483 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-00e7f95c-0dee-496b-942f-6e85ce0cf39a tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:33.544100 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-00e7f95c-0dee-496b-942f-6e85ce0cf39a tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:33.545187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-00e7f95c-0dee-496b-942f-6e85ce0cf39a tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:33.546855 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-00e7f95c-0dee-496b-942f-6e85ce0cf39a tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:33.550584 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-00e7f95c-0dee-496b-942f-6e85ce0cf39a tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:33.835987 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-04f25f94-66ff-457a-9920-6d719db10c9d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:33.848207 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-04f25f94-66ff-457a-9920-6d719db10c9d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1322 microversion: 2.1 time: 1.653836 Aug 04 10:25:33.868514 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 23/44] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:32 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1322 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:25:33.886063 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-283352c4-8bdb-49e0-93b5-bb411eeba3ba tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:33.887146 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-283352c4-8bdb-49e0-93b5-bb411eeba3ba tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:33.901316 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-283352c4-8bdb-49e0-93b5-bb411eeba3ba tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:33.902788 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-283352c4-8bdb-49e0-93b5-bb411eeba3ba tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:33.903168 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-283352c4-8bdb-49e0-93b5-bb411eeba3ba tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:33.903819 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-283352c4-8bdb-49e0-93b5-bb411eeba3ba tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:33.914956 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-00e7f95c-0dee-496b-942f-6e85ce0cf39a tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:33.963890 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-00e7f95c-0dee-496b-942f-6e85ce0cf39a tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1273 microversion: 2.1 time: 0.446789 Aug 04 10:25:33.986801 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 22/45] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:33 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1273 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:34.122839 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-283352c4-8bdb-49e0-93b5-bb411eeba3ba tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:34.131677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-283352c4-8bdb-49e0-93b5-bb411eeba3ba tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1288 microversion: 2.1 time: 0.261821 Aug 04 10:25:34.134842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 24/46] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:33 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1288 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:34.882760 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1a4edc0c-252f-4887-9187-cb2c12d481f7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:34.884837 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-1a4edc0c-252f-4887-9187-cb2c12d481f7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:34.904956 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1a4edc0c-252f-4887-9187-cb2c12d481f7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:34.905469 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1a4edc0c-252f-4887-9187-cb2c12d481f7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:34.924541 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1a4edc0c-252f-4887-9187-cb2c12d481f7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:34.926006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1a4edc0c-252f-4887-9187-cb2c12d481f7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:34.991572 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3405fd96-80d5-40d1-a1c2-492f22e09738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:34.992428 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3405fd96-80d5-40d1-a1c2-492f22e09738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:35.008062 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3405fd96-80d5-40d1-a1c2-492f22e09738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:35.008530 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3405fd96-80d5-40d1-a1c2-492f22e09738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:35.011539 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3405fd96-80d5-40d1-a1c2-492f22e09738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:35.012117 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3405fd96-80d5-40d1-a1c2-492f22e09738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:36.007670 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:36.209960 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3405fd96-80d5-40d1-a1c2-492f22e09738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:36.252675 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3405fd96-80d5-40d1-a1c2-492f22e09738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1273 microversion: 2.1 time: 1.262596 Aug 04 10:25:36.265674 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 25/47] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:34 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1273 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:36.276556 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fe33025a-721a-4920-a48a-e7eef718bf8e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:36.278113 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fe33025a-721a-4920-a48a-e7eef718bf8e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:36.301663 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe33025a-721a-4920-a48a-e7eef718bf8e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:36.302125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe33025a-721a-4920-a48a-e7eef718bf8e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:36.302927 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe33025a-721a-4920-a48a-e7eef718bf8e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:36.305563 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fe33025a-721a-4920-a48a-e7eef718bf8e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:37.147729 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-1a4edc0c-252f-4887-9187-cb2c12d481f7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:37.164690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-1a4edc0c-252f-4887-9187-cb2c12d481f7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1322 microversion: 2.1 time: 2.293404 Aug 04 10:25:37.165297 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 23/48] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:34 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1322 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:37.180909 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fe33025a-721a-4920-a48a-e7eef718bf8e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:37.197047 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fe33025a-721a-4920-a48a-e7eef718bf8e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1294 microversion: 2.1 time: 0.930132 Aug 04 10:25:37.197909 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 26/49] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:36 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1294 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:37.275912 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c68d6be3-3769-4fb6-a06e-4476cd5cd8b3 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:37.277134 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c68d6be3-3769-4fb6-a06e-4476cd5cd8b3 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:37.298029 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c68d6be3-3769-4fb6-a06e-4476cd5cd8b3 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:37.299327 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c68d6be3-3769-4fb6-a06e-4476cd5cd8b3 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:37.305049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c68d6be3-3769-4fb6-a06e-4476cd5cd8b3 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:37.306686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c68d6be3-3769-4fb6-a06e-4476cd5cd8b3 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:37.827487 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-d726464b-f9d8-4d62-b7ca-ffbbc8f21a24 req-e218fef1-80b2-422f-b63c-07845e0418d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78fe279-9634-4426-8cab-5995ab7707a4", "tag": "10285606-ce60-4931-8535-fc691ea023a3"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:37.862279 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-d726464b-f9d8-4d62-b7ca-ffbbc8f21a24 req-e218fef1-80b2-422f-b63c-07845e0418d5 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:37.862734 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-d726464b-f9d8-4d62-b7ca-ffbbc8f21a24 req-e218fef1-80b2-422f-b63c-07845e0418d5 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:37.903642 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-d726464b-f9d8-4d62-b7ca-ffbbc8f21a24 req-e218fef1-80b2-422f-b63c-07845e0418d5 service nova] Creating event network-changed:10285606-ce60-4931-8535-fc691ea023a3 for instance d78fe279-9634-4426-8cab-5995ab7707a4 on hv-cinder-82660 Aug 04 10:25:37.944981 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-d726464b-f9d8-4d62-b7ca-ffbbc8f21a24 req-e218fef1-80b2-422f-b63c-07845e0418d5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.777150 Aug 04 10:25:37.947745 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 24/50] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:38.187944 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-575a5f37-afe0-442b-b40e-22347208d044 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:38.189626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-575a5f37-afe0-442b-b40e-22347208d044 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:38.206802 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-575a5f37-afe0-442b-b40e-22347208d044 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:38.207541 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-575a5f37-afe0-442b-b40e-22347208d044 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:38.208660 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-575a5f37-afe0-442b-b40e-22347208d044 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:38.212911 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-575a5f37-afe0-442b-b40e-22347208d044 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:38.610695 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c68d6be3-3769-4fb6-a06e-4476cd5cd8b3 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:38.626507 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c68d6be3-3769-4fb6-a06e-4476cd5cd8b3 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1315 microversion: 2.1 time: 1.355810 Aug 04 10:25:38.627100 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 27/51] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:37 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1315 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:38.637709 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c2cd9a75-80fa-42af-8788-966aad2ef88c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:38.638363 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c2cd9a75-80fa-42af-8788-966aad2ef88c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:38.669227 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c2cd9a75-80fa-42af-8788-966aad2ef88c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:38.669665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c2cd9a75-80fa-42af-8788-966aad2ef88c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:38.670436 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c2cd9a75-80fa-42af-8788-966aad2ef88c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:38.671147 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c2cd9a75-80fa-42af-8788-966aad2ef88c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:39.038694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=26 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:39.496748 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c2cd9a75-80fa-42af-8788-966aad2ef88c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:39.511336 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c2cd9a75-80fa-42af-8788-966aad2ef88c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1294 microversion: 2.1 time: 0.875043 Aug 04 10:25:39.512348 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 28/52] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:38 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1294 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:39.638149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-575a5f37-afe0-442b-b40e-22347208d044 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:39.656985 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ca879aa0-ab27-4ccd-b292-bf131866f82e tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:39.661211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ca879aa0-ab27-4ccd-b292-bf131866f82e tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:39.676917 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-575a5f37-afe0-442b-b40e-22347208d044 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1322 microversion: 2.1 time: 1.494230 Aug 04 10:25:39.681624 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ca879aa0-ab27-4ccd-b292-bf131866f82e tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:39.682407 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 25/53] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:38 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1322 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:25:39.686983 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ca879aa0-ab27-4ccd-b292-bf131866f82e tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:39.688909 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ca879aa0-ab27-4ccd-b292-bf131866f82e tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:39.690040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ca879aa0-ab27-4ccd-b292-bf131866f82e tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:39.815263 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-856077641", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb532c69-9dbe-4e1f-90c6-af7f1f84969a"}], "security_groups": [{"name": "tempest-securitygroup--245314769"}], "key_name": "tempest-keypair-2001758252", "user_data": "}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:40.314345 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ca879aa0-ab27-4ccd-b292-bf131866f82e tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:40.330396 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ca879aa0-ab27-4ccd-b292-bf131866f82e tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1315 microversion: 2.1 time: 0.682740 Aug 04 10:25:40.330986 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 29/54] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:39 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:40.369092 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.network.neutron [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] validate_networks() for [('cb532c69-9dbe-4e1f-90c6-af7f1f84969a', None, None, None, None, None)] {{(pid=117667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:25:40.510293 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-922605480", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "efa95d14-4335-4752-bcd1-62814f92872f"}], "security_groups": [{"name": "tempest-securitygroup--1207314717"}], "key_name": "tempest-keypair-398068509", "user_data": "}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:40.898246 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] validate_networks() for [('efa95d14-4335-4752-bcd1-62814f92872f', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:25:41.731619 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=11 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:42.012008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Flavor limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:25:42.012567 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Image limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:25:42.012986 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Flavor pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:25:42.013459 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Image pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:25:42.013995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:25:42.016163 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:42.038343 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=19 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:42.041858 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:42.042716 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:42.043481 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:42.044454 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:42.079828 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Getting quotas for project 35576cef915b41419fc74b0beea0f988. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:25:42.085283 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Getting quotas for user 7213149649d249f2b2da3d6c7dac0a68 and project 35576cef915b41419fc74b0beea0f988. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:25:42.105629 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Going to run 1 instances... {{(pid=117667) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:25:42.109533 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:25:42.187814 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ff01698d-bae2-4c1f-ab28-e479b653943e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.377567 Aug 04 10:25:42.189160 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 26/55] 10.222.0.72 () {62 vars in 1188 bytes} [Thu Aug 4 10:25:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 2380 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 04 10:25:42.196488 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c473d719-9a5e-41c1-8f77-f7a825560f6f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:42.197454 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c473d719-9a5e-41c1-8f77-f7a825560f6f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:42.207742 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c473d719-9a5e-41c1-8f77-f7a825560f6f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:42.209592 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c473d719-9a5e-41c1-8f77-f7a825560f6f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:42.211579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c473d719-9a5e-41c1-8f77-f7a825560f6f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:42.256408 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c473d719-9a5e-41c1-8f77-f7a825560f6f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:42.827385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:25:42.835147 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:25:42.835906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:25:42.836388 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:25:42.836813 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:25:42.867392 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:42.867877 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:42.868707 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:42.869152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:42.881445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=61 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:42.894302 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:25:42.899419 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for user b680411b142642b7acc3585d2481f880 and project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:25:42.914396 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:25:42.916999 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:25:43.036736 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-16cb40ed-ed3b-4fc3-86eb-2a3e878aceba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.531144 Aug 04 10:25:43.045231 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 30/56] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:25:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 2540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 10:25:43.058091 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-877c7073-2856-4f0b-aad1-31dcd70f7404 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:43.060849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-877c7073-2856-4f0b-aad1-31dcd70f7404 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:43.080119 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-877c7073-2856-4f0b-aad1-31dcd70f7404 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:43.080937 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-877c7073-2856-4f0b-aad1-31dcd70f7404 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:43.082395 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-877c7073-2856-4f0b-aad1-31dcd70f7404 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:43.085636 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-877c7073-2856-4f0b-aad1-31dcd70f7404 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:43.578049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c473d719-9a5e-41c1-8f77-f7a825560f6f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:43.595704 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c473d719-9a5e-41c1-8f77-f7a825560f6f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1361 microversion: 2.1 time: 1.404755 Aug 04 10:25:43.609643 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 27/57] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:42 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1361 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:43.618245 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d4f3a05b-77ca-4bf9-a4ed-5e929a183677 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:43.619607 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-d4f3a05b-77ca-4bf9-a4ed-5e929a183677 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:43.653815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d4f3a05b-77ca-4bf9-a4ed-5e929a183677 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:43.656463 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d4f3a05b-77ca-4bf9-a4ed-5e929a183677 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:43.669749 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d4f3a05b-77ca-4bf9-a4ed-5e929a183677 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:43.673937 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d4f3a05b-77ca-4bf9-a4ed-5e929a183677 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:44.092405 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-877c7073-2856-4f0b-aad1-31dcd70f7404 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:44.107982 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-877c7073-2856-4f0b-aad1-31dcd70f7404 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1322 microversion: 2.1 time: 1.058356 Aug 04 10:25:44.120621 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 31/58] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:43 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1322 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:44.134328 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ee4cda84-241f-432e-bf42-7ce7b46d411b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:44.135546 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ee4cda84-241f-432e-bf42-7ce7b46d411b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:44.143011 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee4cda84-241f-432e-bf42-7ce7b46d411b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:44.144335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee4cda84-241f-432e-bf42-7ce7b46d411b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:44.146828 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee4cda84-241f-432e-bf42-7ce7b46d411b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:44.148361 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee4cda84-241f-432e-bf42-7ce7b46d411b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:44.604237 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ee4cda84-241f-432e-bf42-7ce7b46d411b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:44.622001 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d4f3a05b-77ca-4bf9-a4ed-5e929a183677 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:44.640235 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d4f3a05b-77ca-4bf9-a4ed-5e929a183677 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1315 microversion: 2.1 time: 1.027152 Aug 04 10:25:44.640703 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ee4cda84-241f-432e-bf42-7ce7b46d411b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:44.640929 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 28/59] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:43 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1315 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:44.645866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ee4cda84-241f-432e-bf42-7ce7b46d411b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:44.655428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-92889976-6691-458e-b595-0527e63a5e47 req-7a063181-332d-4c3c-92d1-3a409e4d149a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0acb9a2a-4373-41f0-906f-874d170c717d", "tag": "d75794c3-9edf-4849-a7f5-949dab1d0943"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:44.661496 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ee4cda84-241f-432e-bf42-7ce7b46d411b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1339 microversion: 2.20 time: 0.535928 Aug 04 10:25:44.666480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 32/60] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:25:44 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1339 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:25:44.680625 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-92889976-6691-458e-b595-0527e63a5e47 req-7a063181-332d-4c3c-92d1-3a409e4d149a service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:44.680983 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-92889976-6691-458e-b595-0527e63a5e47 req-7a063181-332d-4c3c-92d1-3a409e4d149a service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:44.686971 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6a77b82e-d40e-4114-b584-b5518e58b327 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:44.689090 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6a77b82e-d40e-4114-b584-b5518e58b327 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:44.708318 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-92889976-6691-458e-b595-0527e63a5e47 req-7a063181-332d-4c3c-92d1-3a409e4d149a service nova] Creating event network-changed:d75794c3-9edf-4849-a7f5-949dab1d0943 for instance 0acb9a2a-4373-41f0-906f-874d170c717d on hv-cinder-82660 Aug 04 10:25:44.715827 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-92889976-6691-458e-b595-0527e63a5e47 req-7a063181-332d-4c3c-92d1-3a409e4d149a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072232 Aug 04 10:25:44.717137 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 29/61] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:44.720818 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6a77b82e-d40e-4114-b584-b5518e58b327 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:44.721349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6a77b82e-d40e-4114-b584-b5518e58b327 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:44.722167 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6a77b82e-d40e-4114-b584-b5518e58b327 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:44.724014 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6c29a448-0ab3-4113-9c93-1a7918a5c332 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:44.725266 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6c29a448-0ab3-4113-9c93-1a7918a5c332 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:44.726154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6a77b82e-d40e-4114-b584-b5518e58b327 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:44.734359 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6c29a448-0ab3-4113-9c93-1a7918a5c332 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:44.735186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6c29a448-0ab3-4113-9c93-1a7918a5c332 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:44.736171 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6c29a448-0ab3-4113-9c93-1a7918a5c332 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:44.736754 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6c29a448-0ab3-4113-9c93-1a7918a5c332 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:44.895737 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6a77b82e-d40e-4114-b584-b5518e58b327 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:44.906122 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6a77b82e-d40e-4114-b584-b5518e58b327 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1292 microversion: 2.1 time: 0.237797 Aug 04 10:25:44.907414 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 33/62] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:44 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1292 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:45.099484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6c29a448-0ab3-4113-9c93-1a7918a5c332 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:45.114169 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6c29a448-0ab3-4113-9c93-1a7918a5c332 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1361 microversion: 2.1 time: 0.395573 Aug 04 10:25:45.131033 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bcbfac7e-32b5-4cae-8e09-41ed4b242595 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:45.131614 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bcbfac7e-32b5-4cae-8e09-41ed4b242595 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:45.134125 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 30/63] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:44 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1361 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:45.145686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bcbfac7e-32b5-4cae-8e09-41ed4b242595 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:45.146130 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bcbfac7e-32b5-4cae-8e09-41ed4b242595 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:45.147106 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bcbfac7e-32b5-4cae-8e09-41ed4b242595 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:45.147693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bcbfac7e-32b5-4cae-8e09-41ed4b242595 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:45.351884 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bcbfac7e-32b5-4cae-8e09-41ed4b242595 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:45.366034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bcbfac7e-32b5-4cae-8e09-41ed4b242595 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1322 microversion: 2.1 time: 0.238971 Aug 04 10:25:45.367244 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 34/64] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:45 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:45.663152 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0eebe996-189d-4287-a5ff-ad64a0e4235b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:45.663761 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0eebe996-189d-4287-a5ff-ad64a0e4235b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:45.674058 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0eebe996-189d-4287-a5ff-ad64a0e4235b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:45.674597 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0eebe996-189d-4287-a5ff-ad64a0e4235b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:45.675478 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0eebe996-189d-4287-a5ff-ad64a0e4235b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:45.679056 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0eebe996-189d-4287-a5ff-ad64a0e4235b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:45.695553 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-51944781-2237-40e9-a6a4-19c7e891960d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:45.696402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-51944781-2237-40e9-a6a4-19c7e891960d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:45.706358 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-51944781-2237-40e9-a6a4-19c7e891960d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:45.707040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-51944781-2237-40e9-a6a4-19c7e891960d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:45.708200 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-51944781-2237-40e9-a6a4-19c7e891960d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:45.712052 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-51944781-2237-40e9-a6a4-19c7e891960d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:46.017309 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-51944781-2237-40e9-a6a4-19c7e891960d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:46.028986 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-51944781-2237-40e9-a6a4-19c7e891960d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:46.030660 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-51944781-2237-40e9-a6a4-19c7e891960d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:46.031798 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-51944781-2237-40e9-a6a4-19c7e891960d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1339 microversion: 2.20 time: 0.341002 Aug 04 10:25:46.032380 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 35/65] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:25:45 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1339 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:25:46.036826 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f569f932-daf6-4efc-b249-397a7093057b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:46.037425 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f569f932-daf6-4efc-b249-397a7093057b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:46.066128 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f569f932-daf6-4efc-b249-397a7093057b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:46.066513 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f569f932-daf6-4efc-b249-397a7093057b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:46.068728 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f569f932-daf6-4efc-b249-397a7093057b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:46.069146 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f569f932-daf6-4efc-b249-397a7093057b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:46.325135 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0eebe996-189d-4287-a5ff-ad64a0e4235b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:46.339552 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0eebe996-189d-4287-a5ff-ad64a0e4235b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1315 microversion: 2.1 time: 0.681458 Aug 04 10:25:46.340177 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 31/66] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:45 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:46.356734 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-72978d33-9739-4171-be58-34de1914e4de tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:46.357395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-72978d33-9739-4171-be58-34de1914e4de tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:46.368344 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-72978d33-9739-4171-be58-34de1914e4de tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:46.368909 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-72978d33-9739-4171-be58-34de1914e4de tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:46.369685 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-72978d33-9739-4171-be58-34de1914e4de tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:46.370114 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-72978d33-9739-4171-be58-34de1914e4de tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:46.456243 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f569f932-daf6-4efc-b249-397a7093057b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:46.486774 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f569f932-daf6-4efc-b249-397a7093057b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1298 microversion: 2.1 time: 0.451882 Aug 04 10:25:46.488897 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 36/67] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:46 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1298 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:46.518931 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f4c47098-df82-4246-bd75-b730854c6298 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:46.519563 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f4c47098-df82-4246-bd75-b730854c6298 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:46.536863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f4c47098-df82-4246-bd75-b730854c6298 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:46.539348 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f4c47098-df82-4246-bd75-b730854c6298 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:46.541172 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f4c47098-df82-4246-bd75-b730854c6298 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:46.542225 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f4c47098-df82-4246-bd75-b730854c6298 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:47.310701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-72978d33-9739-4171-be58-34de1914e4de tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:47.330531 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-72978d33-9739-4171-be58-34de1914e4de tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1361 microversion: 2.1 time: 0.988613 Aug 04 10:25:47.331308 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 32/68] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:46 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1361 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:47.341594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-9e5ecbaf-58f7-4f50-b172-d95b62f7c372 req-8b7efff3-d98f-41d1-87c2-d4922ba3f90e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf60275d-fda6-4f0c-8a2f-14f85d685623", "tag": "a7f1ba8f-d703-43d1-94d9-5c0b11630a04"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:47.370372 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-9e5ecbaf-58f7-4f50-b172-d95b62f7c372 req-8b7efff3-d98f-41d1-87c2-d4922ba3f90e service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:47.371514 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-9e5ecbaf-58f7-4f50-b172-d95b62f7c372 req-8b7efff3-d98f-41d1-87c2-d4922ba3f90e service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:47.381949 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f4c47098-df82-4246-bd75-b730854c6298 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:47.396675 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f4c47098-df82-4246-bd75-b730854c6298 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1322 microversion: 2.1 time: 0.887102 Aug 04 10:25:47.397789 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 37/69] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:46 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1322 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:47.418661 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-9e5ecbaf-58f7-4f50-b172-d95b62f7c372 req-8b7efff3-d98f-41d1-87c2-d4922ba3f90e service nova] Creating event network-changed:a7f1ba8f-d703-43d1-94d9-5c0b11630a04 for instance cf60275d-fda6-4f0c-8a2f-14f85d685623 on hv-cinder-82660 Aug 04 10:25:47.428494 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6e49e5fe-1135-4713-85f2-d48a81860dcb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:47.432305 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6e49e5fe-1135-4713-85f2-d48a81860dcb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:47.444477 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-9e5ecbaf-58f7-4f50-b172-d95b62f7c372 req-8b7efff3-d98f-41d1-87c2-d4922ba3f90e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109463 Aug 04 10:25:47.445717 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 33/70] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:47.454738 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6e49e5fe-1135-4713-85f2-d48a81860dcb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:47.459343 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6e49e5fe-1135-4713-85f2-d48a81860dcb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:47.462238 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6e49e5fe-1135-4713-85f2-d48a81860dcb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:47.463449 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6e49e5fe-1135-4713-85f2-d48a81860dcb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:47.561203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6e49e5fe-1135-4713-85f2-d48a81860dcb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:47.579804 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6e49e5fe-1135-4713-85f2-d48a81860dcb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:47.586446 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6e49e5fe-1135-4713-85f2-d48a81860dcb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:47.587711 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6e49e5fe-1135-4713-85f2-d48a81860dcb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1339 microversion: 2.20 time: 0.179477 Aug 04 10:25:47.589127 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 38/71] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:25:47 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1339 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:25:47.625112 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0ef0f94b-86dc-41b8-886b-7c9637628f13 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:47.628524 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0ef0f94b-86dc-41b8-886b-7c9637628f13 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:47.644493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ef0f94b-86dc-41b8-886b-7c9637628f13 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:47.646167 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ef0f94b-86dc-41b8-886b-7c9637628f13 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:47.649016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ef0f94b-86dc-41b8-886b-7c9637628f13 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:47.649634 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0ef0f94b-86dc-41b8-886b-7c9637628f13 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:47.991924 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-4a238b78-929c-4513-9ebe-f6a2ef4082f2 req-791fce0a-9b5a-466e-abc0-b3c5e90e3a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef5108fd-663e-4c6a-bab7-2c706a4b0ebe", "name": "network-vif-plugged", "status": "completed", "tag": "82ef3eba-27a2-4b68-aaaa-c836e1bc348b"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:48.020873 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-4a238b78-929c-4513-9ebe-f6a2ef4082f2 req-791fce0a-9b5a-466e-abc0-b3c5e90e3a89 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:48.024693 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-4a238b78-929c-4513-9ebe-f6a2ef4082f2 req-791fce0a-9b5a-466e-abc0-b3c5e90e3a89 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:48.063509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-4a238b78-929c-4513-9ebe-f6a2ef4082f2 req-791fce0a-9b5a-466e-abc0-b3c5e90e3a89 service nova] Creating event network-vif-plugged:82ef3eba-27a2-4b68-aaaa-c836e1bc348b for instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe on hv-cinder-82660 Aug 04 10:25:48.083586 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-4a238b78-929c-4513-9ebe-f6a2ef4082f2 req-791fce0a-9b5a-466e-abc0-b3c5e90e3a89 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.634604 Aug 04 10:25:48.086073 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 34/72] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:48.098949 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a09c7a10-35be-491c-971e-a671d88630ee tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:48.113132 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a09c7a10-35be-491c-971e-a671d88630ee tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:48.123286 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a09c7a10-35be-491c-971e-a671d88630ee tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:48.124136 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a09c7a10-35be-491c-971e-a671d88630ee tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:48.125088 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a09c7a10-35be-491c-971e-a671d88630ee tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:48.125687 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a09c7a10-35be-491c-971e-a671d88630ee tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:48.196101 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0ef0f94b-86dc-41b8-886b-7c9637628f13 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:48.210565 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0ef0f94b-86dc-41b8-886b-7c9637628f13 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1315 microversion: 2.1 time: 0.610109 Aug 04 10:25:48.211190 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 39/73] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:47 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:48.355239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ce7fcc03-ae1f-47e8-beb5-881008775d4d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:48.355864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ce7fcc03-ae1f-47e8-beb5-881008775d4d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:48.371594 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce7fcc03-ae1f-47e8-beb5-881008775d4d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:48.375592 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce7fcc03-ae1f-47e8-beb5-881008775d4d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:48.376503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce7fcc03-ae1f-47e8-beb5-881008775d4d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:48.377035 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce7fcc03-ae1f-47e8-beb5-881008775d4d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:48.815246 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ce7fcc03-ae1f-47e8-beb5-881008775d4d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:48.825893 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ce7fcc03-ae1f-47e8-beb5-881008775d4d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1361 microversion: 2.1 time: 0.474381 Aug 04 10:25:48.828643 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 40/74] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:48 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1361 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:48.844786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a09c7a10-35be-491c-971e-a671d88630ee tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:48.846492 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6bfd3fc0-ef8e-4f8b-82ed-7b00b65cdaed tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:48.847436 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6bfd3fc0-ef8e-4f8b-82ed-7b00b65cdaed tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:48.854706 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6bfd3fc0-ef8e-4f8b-82ed-7b00b65cdaed tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:48.856556 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6bfd3fc0-ef8e-4f8b-82ed-7b00b65cdaed tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:48.858827 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6bfd3fc0-ef8e-4f8b-82ed-7b00b65cdaed tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:48.860887 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6bfd3fc0-ef8e-4f8b-82ed-7b00b65cdaed tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:48.861748 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a09c7a10-35be-491c-971e-a671d88630ee tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1366 microversion: 2.1 time: 0.766896 Aug 04 10:25:48.863658 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 35/75] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:48 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1366 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:48.869644 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e792203f-bce6-416f-99c3-af2c3c803642 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:48.870472 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e792203f-bce6-416f-99c3-af2c3c803642 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:48.881227 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e792203f-bce6-416f-99c3-af2c3c803642 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:48.885474 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e792203f-bce6-416f-99c3-af2c3c803642 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:48.885474 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e792203f-bce6-416f-99c3-af2c3c803642 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:48.885474 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e792203f-bce6-416f-99c3-af2c3c803642 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:49.184149 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6bfd3fc0-ef8e-4f8b-82ed-7b00b65cdaed tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:49.192472 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6bfd3fc0-ef8e-4f8b-82ed-7b00b65cdaed tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1322 microversion: 2.1 time: 0.362110 Aug 04 10:25:49.193041 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 41/76] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:48 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:49.231984 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0a0fd356-d9da-41b5-b346-688e3d284a66 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:49.232843 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0a0fd356-d9da-41b5-b346-688e3d284a66 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:49.238196 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e792203f-bce6-416f-99c3-af2c3c803642 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:49.249404 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a0fd356-d9da-41b5-b346-688e3d284a66 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:49.250120 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a0fd356-d9da-41b5-b346-688e3d284a66 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:49.251663 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a0fd356-d9da-41b5-b346-688e3d284a66 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:49.252282 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a0fd356-d9da-41b5-b346-688e3d284a66 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:49.255748 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e792203f-bce6-416f-99c3-af2c3c803642 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:49.260165 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e792203f-bce6-416f-99c3-af2c3c803642 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:49.265205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e792203f-bce6-416f-99c3-af2c3c803642 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1406 microversion: 2.20 time: 0.395996 Aug 04 10:25:49.277855 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 36/77] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:25:48 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1406 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:25:49.376904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-f0064e4b-82ce-4744-8d5a-4df0833718b4 req-7417720d-41ff-4ed5-8f1d-c1530b13e299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0396f5e6-1b64-4b0f-9352-28165af5878b", "tag": "46e7bd28-a5a1-4c48-aa21-1a4902096c91"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:49.394458 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-f0064e4b-82ce-4744-8d5a-4df0833718b4 req-7417720d-41ff-4ed5-8f1d-c1530b13e299 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:49.395353 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-f0064e4b-82ce-4744-8d5a-4df0833718b4 req-7417720d-41ff-4ed5-8f1d-c1530b13e299 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:49.408489 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-f0064e4b-82ce-4744-8d5a-4df0833718b4 req-7417720d-41ff-4ed5-8f1d-c1530b13e299 service nova] Creating event network-changed:46e7bd28-a5a1-4c48-aa21-1a4902096c91 for instance 0396f5e6-1b64-4b0f-9352-28165af5878b on hv-cinder-82660 Aug 04 10:25:49.413548 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-f0064e4b-82ce-4744-8d5a-4df0833718b4 req-7417720d-41ff-4ed5-8f1d-c1530b13e299 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047428 Aug 04 10:25:49.414747 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 37/78] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:49.632027 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0a0fd356-d9da-41b5-b346-688e3d284a66 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:49.641773 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0a0fd356-d9da-41b5-b346-688e3d284a66 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1315 microversion: 2.1 time: 0.413229 Aug 04 10:25:49.643627 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 42/79] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:49 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:25:49.850632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-14ed3c00-cca5-4a49-a69a-2d0219eb3da0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:49.851481 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-14ed3c00-cca5-4a49-a69a-2d0219eb3da0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:49.864458 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-14ed3c00-cca5-4a49-a69a-2d0219eb3da0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:49.865472 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-14ed3c00-cca5-4a49-a69a-2d0219eb3da0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:49.867401 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-14ed3c00-cca5-4a49-a69a-2d0219eb3da0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:49.869341 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-14ed3c00-cca5-4a49-a69a-2d0219eb3da0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:49.888937 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-653d2ae4-e652-4220-bee4-e8e8c75becf7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:49.891504 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-653d2ae4-e652-4220-bee4-e8e8c75becf7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:49.905935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-653d2ae4-e652-4220-bee4-e8e8c75becf7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:49.906700 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-653d2ae4-e652-4220-bee4-e8e8c75becf7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:49.907597 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-653d2ae4-e652-4220-bee4-e8e8c75becf7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:49.908220 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-653d2ae4-e652-4220-bee4-e8e8c75becf7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:50.232789 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-653d2ae4-e652-4220-bee4-e8e8c75becf7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:50.253130 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-14ed3c00-cca5-4a49-a69a-2d0219eb3da0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:50.261013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-14ed3c00-cca5-4a49-a69a-2d0219eb3da0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1361 microversion: 2.1 time: 0.415494 Aug 04 10:25:50.261593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 38/80] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:49 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1361 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:50.264186 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-653d2ae4-e652-4220-bee4-e8e8c75becf7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1366 microversion: 2.1 time: 0.379926 Aug 04 10:25:50.265256 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 43/81] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:49 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:25:50.271863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-7451f865-9a25-4ebb-86c2-db242be96cae req-24ab679f-cf49-4257-baba-9d094360511c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78fe279-9634-4426-8cab-5995ab7707a4", "name": "network-vif-plugged", "status": "completed", "tag": "10285606-ce60-4931-8535-fc691ea023a3"}, {"server_uuid": "0acb9a2a-4373-41f0-906f-874d170c717d", "name": "network-vif-plugged", "status": "completed", "tag": "d75794c3-9edf-4849-a7f5-949dab1d0943"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:50.277718 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8cf0faa6-c8b0-46cb-8033-13fbad67dcb8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:50.286892 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8cf0faa6-c8b0-46cb-8033-13fbad67dcb8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:50.304692 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8cf0faa6-c8b0-46cb-8033-13fbad67dcb8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:50.305149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8cf0faa6-c8b0-46cb-8033-13fbad67dcb8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:50.305930 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8cf0faa6-c8b0-46cb-8033-13fbad67dcb8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:50.306360 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8cf0faa6-c8b0-46cb-8033-13fbad67dcb8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:50.327275 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-7451f865-9a25-4ebb-86c2-db242be96cae req-24ab679f-cf49-4257-baba-9d094360511c service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:50.327711 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-7451f865-9a25-4ebb-86c2-db242be96cae req-24ab679f-cf49-4257-baba-9d094360511c service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:50.374651 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-7451f865-9a25-4ebb-86c2-db242be96cae req-24ab679f-cf49-4257-baba-9d094360511c service nova] Creating event network-vif-plugged:10285606-ce60-4931-8535-fc691ea023a3 for instance d78fe279-9634-4426-8cab-5995ab7707a4 on hv-cinder-82660 Aug 04 10:25:50.378717 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-7451f865-9a25-4ebb-86c2-db242be96cae req-24ab679f-cf49-4257-baba-9d094360511c service nova] Creating event network-vif-plugged:d75794c3-9edf-4849-a7f5-949dab1d0943 for instance 0acb9a2a-4373-41f0-906f-874d170c717d on hv-cinder-82660 Aug 04 10:25:50.379801 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-7451f865-9a25-4ebb-86c2-db242be96cae req-24ab679f-cf49-4257-baba-9d094360511c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117666) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 10:25:50.382502 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc53f2fb-866f-4b83-b509-17d75c0be8d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:50.383557 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc53f2fb-866f-4b83-b509-17d75c0be8d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:50.385438 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc53f2fb-866f-4b83-b509-17d75c0be8d3 None None] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:50.386115 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc53f2fb-866f-4b83-b509-17d75c0be8d3 None None] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:50.405563 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.compute.rpcapi [None req-fc53f2fb-866f-4b83-b509-17d75c0be8d3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 10:25:50.410800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc53f2fb-866f-4b83-b509-17d75c0be8d3 None None] Releasing lock "compute-rpcapi-router" {{(pid=117666) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 10:25:50.456852 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fc53f2fb-866f-4b83-b509-17d75c0be8d3 None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.190213 Aug 04 10:25:50.457764 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 44/82] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:50.462920 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4487a38b-8594-43b1-baba-08d5d35b62a8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:50.463607 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4487a38b-8594-43b1-baba-08d5d35b62a8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:50.484654 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4487a38b-8594-43b1-baba-08d5d35b62a8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:50.485223 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4487a38b-8594-43b1-baba-08d5d35b62a8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:50.488245 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4487a38b-8594-43b1-baba-08d5d35b62a8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:50.488691 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4487a38b-8594-43b1-baba-08d5d35b62a8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:50.627841 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8cf0faa6-c8b0-46cb-8033-13fbad67dcb8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:50.641895 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8cf0faa6-c8b0-46cb-8033-13fbad67dcb8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1322 microversion: 2.1 time: 0.372590 Aug 04 10:25:50.642509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 39/83] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:50 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:50.665152 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ed719f8a-ea8b-4cfa-8c29-1ff222e6d4de tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:50.666004 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ed719f8a-ea8b-4cfa-8c29-1ff222e6d4de tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:50.683579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ed719f8a-ea8b-4cfa-8c29-1ff222e6d4de tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:50.684696 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ed719f8a-ea8b-4cfa-8c29-1ff222e6d4de tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:50.685651 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ed719f8a-ea8b-4cfa-8c29-1ff222e6d4de tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:50.686287 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ed719f8a-ea8b-4cfa-8c29-1ff222e6d4de tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:51.284946 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4487a38b-8594-43b1-baba-08d5d35b62a8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:51.296748 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4487a38b-8594-43b1-baba-08d5d35b62a8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:51.299408 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4487a38b-8594-43b1-baba-08d5d35b62a8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:51.306432 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4487a38b-8594-43b1-baba-08d5d35b62a8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1406 microversion: 2.20 time: 0.847488 Aug 04 10:25:51.320452 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 45/84] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:25:50 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1406 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:25:51.327928 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ab6b8ea9-2cd9-41cf-8e43-d755c9c40cc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:51.328713 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ab6b8ea9-2cd9-41cf-8e43-d755c9c40cc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:51.335672 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab6b8ea9-2cd9-41cf-8e43-d755c9c40cc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:51.336334 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab6b8ea9-2cd9-41cf-8e43-d755c9c40cc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:51.337265 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab6b8ea9-2cd9-41cf-8e43-d755c9c40cc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:51.337945 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab6b8ea9-2cd9-41cf-8e43-d755c9c40cc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:51.438568 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-ed719f8a-ea8b-4cfa-8c29-1ff222e6d4de tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:51.450136 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ed719f8a-ea8b-4cfa-8c29-1ff222e6d4de tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1315 microversion: 2.1 time: 0.789175 Aug 04 10:25:51.450995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 40/85] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:50 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1315 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:51.471816 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e13972d3-45e6-4b6c-955e-a38b142cd5db tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:51.472465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e13972d3-45e6-4b6c-955e-a38b142cd5db tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:51.478701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e13972d3-45e6-4b6c-955e-a38b142cd5db tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:51.479559 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e13972d3-45e6-4b6c-955e-a38b142cd5db tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:51.480412 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e13972d3-45e6-4b6c-955e-a38b142cd5db tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:51.480941 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e13972d3-45e6-4b6c-955e-a38b142cd5db tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:51.503230 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=100 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:51.650798 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ab6b8ea9-2cd9-41cf-8e43-d755c9c40cc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:51.660852 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ab6b8ea9-2cd9-41cf-8e43-d755c9c40cc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1361 microversion: 2.1 time: 0.339071 Aug 04 10:25:51.661421 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 46/86] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:51 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1361 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:51.666490 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-f1434909-28f4-4166-9c36-2aab72ad9bc9 req-26426f6d-28eb-4347-b7ef-127ec0ed741e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d55a58c-f47e-4284-9ffa-f7fb642845fb", "tag": "a1ddb5a5-2348-4975-a3d0-581514d978c0"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:51.676733 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-f1434909-28f4-4166-9c36-2aab72ad9bc9 req-26426f6d-28eb-4347-b7ef-127ec0ed741e service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:51.677384 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-f1434909-28f4-4166-9c36-2aab72ad9bc9 req-26426f6d-28eb-4347-b7ef-127ec0ed741e service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:51.690283 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-f1434909-28f4-4166-9c36-2aab72ad9bc9 req-26426f6d-28eb-4347-b7ef-127ec0ed741e service nova] Creating event network-changed:a1ddb5a5-2348-4975-a3d0-581514d978c0 for instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb on hv-cinder-82660 Aug 04 10:25:51.696767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-f1434909-28f4-4166-9c36-2aab72ad9bc9 req-26426f6d-28eb-4347-b7ef-127ec0ed741e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033916 Aug 04 10:25:51.697737 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 47/87] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:51.704676 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d5834945-2a65-4486-9607-1bd8b9d78c59 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:51.705873 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d5834945-2a65-4486-9607-1bd8b9d78c59 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:51.721640 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5834945-2a65-4486-9607-1bd8b9d78c59 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:51.722094 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5834945-2a65-4486-9607-1bd8b9d78c59 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:51.723312 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5834945-2a65-4486-9607-1bd8b9d78c59 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:51.723747 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5834945-2a65-4486-9607-1bd8b9d78c59 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:51.749728 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:51.772831 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e13972d3-45e6-4b6c-955e-a38b142cd5db tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:51.780475 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e13972d3-45e6-4b6c-955e-a38b142cd5db tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1366 microversion: 2.1 time: 0.314233 Aug 04 10:25:51.792969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 41/88] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:51 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:51.979948 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d5834945-2a65-4486-9607-1bd8b9d78c59 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:52.013266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d5834945-2a65-4486-9607-1bd8b9d78c59 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1322 microversion: 2.1 time: 0.313569 Aug 04 10:25:52.020327 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 48/89] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:51 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:52.333098 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5d9f57cb-f1e0-426b-8faa-ab501716d5ea tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:52.333745 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5d9f57cb-f1e0-426b-8faa-ab501716d5ea tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:52.336030 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=6 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:52.336977 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=5 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:52.354045 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5d9f57cb-f1e0-426b-8faa-ab501716d5ea tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:52.354674 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5d9f57cb-f1e0-426b-8faa-ab501716d5ea tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:52.355613 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5d9f57cb-f1e0-426b-8faa-ab501716d5ea tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:52.356228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5d9f57cb-f1e0-426b-8faa-ab501716d5ea tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:52.472849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e0bafc0b-ca93-4cf0-a345-e8e2c4c4d482 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:52.474525 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e0bafc0b-ca93-4cf0-a345-e8e2c4c4d482 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:52.486230 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0bafc0b-ca93-4cf0-a345-e8e2c4c4d482 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:52.495392 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0bafc0b-ca93-4cf0-a345-e8e2c4c4d482 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:52.496670 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0bafc0b-ca93-4cf0-a345-e8e2c4c4d482 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:52.501837 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0bafc0b-ca93-4cf0-a345-e8e2c4c4d482 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:52.626686 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5d9f57cb-f1e0-426b-8faa-ab501716d5ea tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:52.643353 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5d9f57cb-f1e0-426b-8faa-ab501716d5ea tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:52.647613 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5d9f57cb-f1e0-426b-8faa-ab501716d5ea tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:52.649430 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5d9f57cb-f1e0-426b-8faa-ab501716d5ea tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1406 microversion: 2.20 time: 0.320344 Aug 04 10:25:52.651282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 42/90] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:25:52 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:25:52.688666 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4f9437bd-b1c9-49c4-901b-2f1fc74f5d0d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:52.689543 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4f9437bd-b1c9-49c4-901b-2f1fc74f5d0d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:52.701937 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4f9437bd-b1c9-49c4-901b-2f1fc74f5d0d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:52.709708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4f9437bd-b1c9-49c4-901b-2f1fc74f5d0d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:52.710779 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4f9437bd-b1c9-49c4-901b-2f1fc74f5d0d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:52.711249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4f9437bd-b1c9-49c4-901b-2f1fc74f5d0d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:52.792336 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e0bafc0b-ca93-4cf0-a345-e8e2c4c4d482 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:52.804576 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e0bafc0b-ca93-4cf0-a345-e8e2c4c4d482 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1315 microversion: 2.1 time: 0.332895 Aug 04 10:25:52.812122 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 49/91] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:52 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:25:52.827189 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-5b6d6e16-66e6-41f9-a79a-0e8a18d41d59 req-683dc586-8921-49da-8c21-86dc0cc00d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf60275d-fda6-4f0c-8a2f-14f85d685623", "name": "network-vif-plugged", "status": "completed", "tag": "a7f1ba8f-d703-43d1-94d9-5c0b11630a04"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:52.847432 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-5b6d6e16-66e6-41f9-a79a-0e8a18d41d59 req-683dc586-8921-49da-8c21-86dc0cc00d82 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:52.848210 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-5b6d6e16-66e6-41f9-a79a-0e8a18d41d59 req-683dc586-8921-49da-8c21-86dc0cc00d82 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:52.863130 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-5b6d6e16-66e6-41f9-a79a-0e8a18d41d59 req-683dc586-8921-49da-8c21-86dc0cc00d82 service nova] Creating event network-vif-plugged:a7f1ba8f-d703-43d1-94d9-5c0b11630a04 for instance cf60275d-fda6-4f0c-8a2f-14f85d685623 on hv-cinder-82660 Aug 04 10:25:52.888569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-5b6d6e16-66e6-41f9-a79a-0e8a18d41d59 req-683dc586-8921-49da-8c21-86dc0cc00d82 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072973 Aug 04 10:25:52.891040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 50/92] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:52.909384 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-11e3938b-fcc2-45d5-b2ea-192c2b8005b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:52.911536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-11e3938b-fcc2-45d5-b2ea-192c2b8005b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:52.921554 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:52.941913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11e3938b-fcc2-45d5-b2ea-192c2b8005b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:52.941913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11e3938b-fcc2-45d5-b2ea-192c2b8005b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:52.942858 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11e3938b-fcc2-45d5-b2ea-192c2b8005b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:52.942858 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11e3938b-fcc2-45d5-b2ea-192c2b8005b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:53.168515 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4f9437bd-b1c9-49c4-901b-2f1fc74f5d0d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:53.179500 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4f9437bd-b1c9-49c4-901b-2f1fc74f5d0d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1361 microversion: 2.1 time: 0.499804 Aug 04 10:25:53.194004 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 43/93] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:52 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1361 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:53.199142 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-bd23877e-19e2-49cc-bc15-c2165d89fe5c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:53.199760 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-bd23877e-19e2-49cc-bc15-c2165d89fe5c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:53.207370 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd23877e-19e2-49cc-bc15-c2165d89fe5c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:53.207827 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd23877e-19e2-49cc-bc15-c2165d89fe5c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:53.208640 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd23877e-19e2-49cc-bc15-c2165d89fe5c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:53.209080 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd23877e-19e2-49cc-bc15-c2165d89fe5c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:53.226424 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-11e3938b-fcc2-45d5-b2ea-192c2b8005b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:53.239999 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-11e3938b-fcc2-45d5-b2ea-192c2b8005b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1366 microversion: 2.1 time: 0.346683 Aug 04 10:25:53.241549 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 51/94] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:52 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:53.385576 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bd23877e-19e2-49cc-bc15-c2165d89fe5c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:53.394689 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-bd23877e-19e2-49cc-bc15-c2165d89fe5c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1322 microversion: 2.1 time: 0.199046 Aug 04 10:25:53.408479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 44/95] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:53 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:53.685555 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-96b457d4-836b-4be5-97e8-94a48355d809 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:53.686741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-96b457d4-836b-4be5-97e8-94a48355d809 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:53.711340 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96b457d4-836b-4be5-97e8-94a48355d809 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:53.724069 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96b457d4-836b-4be5-97e8-94a48355d809 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:53.724069 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96b457d4-836b-4be5-97e8-94a48355d809 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:53.724069 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96b457d4-836b-4be5-97e8-94a48355d809 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:53.837074 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ea45cdef-75e9-49f3-89c3-8bbab9084a2b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:53.843908 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ea45cdef-75e9-49f3-89c3-8bbab9084a2b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:53.851301 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ea45cdef-75e9-49f3-89c3-8bbab9084a2b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:53.852144 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ea45cdef-75e9-49f3-89c3-8bbab9084a2b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:53.853794 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ea45cdef-75e9-49f3-89c3-8bbab9084a2b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:53.854695 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ea45cdef-75e9-49f3-89c3-8bbab9084a2b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:53.967299 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-96b457d4-836b-4be5-97e8-94a48355d809 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:53.976385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-96b457d4-836b-4be5-97e8-94a48355d809 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:53.978213 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-96b457d4-836b-4be5-97e8-94a48355d809 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:53.979623 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-96b457d4-836b-4be5-97e8-94a48355d809 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1406 microversion: 2.20 time: 0.308989 Aug 04 10:25:53.980867 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 52/96] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:25:53 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:25:54.049107 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-ea45cdef-75e9-49f3-89c3-8bbab9084a2b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:54.056998 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ea45cdef-75e9-49f3-89c3-8bbab9084a2b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1315 microversion: 2.1 time: 0.232381 Aug 04 10:25:54.057569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 45/97] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:53 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:54.203646 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-63f11401-bf33-4f1b-9f4b-035a0873a547 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:54.204291 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-63f11401-bf33-4f1b-9f4b-035a0873a547 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:54.214040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-63f11401-bf33-4f1b-9f4b-035a0873a547 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:54.214781 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-63f11401-bf33-4f1b-9f4b-035a0873a547 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:54.216006 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-63f11401-bf33-4f1b-9f4b-035a0873a547 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:54.216804 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-63f11401-bf33-4f1b-9f4b-035a0873a547 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:54.266857 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-96512bf8-e071-471e-b957-f626868b081e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:54.272636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-96512bf8-e071-471e-b957-f626868b081e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:54.282894 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-96512bf8-e071-471e-b957-f626868b081e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:54.286664 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-96512bf8-e071-471e-b957-f626868b081e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:54.288506 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-96512bf8-e071-471e-b957-f626868b081e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:54.289220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-96512bf8-e071-471e-b957-f626868b081e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:54.442106 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-63f11401-bf33-4f1b-9f4b-035a0873a547 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:54.451473 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-63f11401-bf33-4f1b-9f4b-035a0873a547 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1361 microversion: 2.1 time: 0.254721 Aug 04 10:25:54.469086 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 53/98] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:54 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:54.477106 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7115c7df-8eef-47de-b5c2-261d8152f3bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:54.478374 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7115c7df-8eef-47de-b5c2-261d8152f3bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:54.494707 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7115c7df-8eef-47de-b5c2-261d8152f3bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:54.495424 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7115c7df-8eef-47de-b5c2-261d8152f3bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:54.496230 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7115c7df-8eef-47de-b5c2-261d8152f3bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:54.496669 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7115c7df-8eef-47de-b5c2-261d8152f3bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:54.792931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-96512bf8-e071-471e-b957-f626868b081e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:54.801072 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-96512bf8-e071-471e-b957-f626868b081e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1366 microversion: 2.1 time: 0.542747 Aug 04 10:25:54.801635 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 46/99] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:54 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1366 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:25:54.848693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7115c7df-8eef-47de-b5c2-261d8152f3bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:54.859043 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7115c7df-8eef-47de-b5c2-261d8152f3bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1322 microversion: 2.1 time: 0.388794 Aug 04 10:25:54.859870 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 54/100] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:54 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:54.913992 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-91dc83e1-d7a3-4eda-a6df-b4c749ef4c0e req-ff89e12b-5d63-4356-9568-2133a696b40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0396f5e6-1b64-4b0f-9352-28165af5878b", "name": "network-vif-plugged", "status": "completed", "tag": "46e7bd28-a5a1-4c48-aa21-1a4902096c91"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:54.926838 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-91dc83e1-d7a3-4eda-a6df-b4c749ef4c0e req-ff89e12b-5d63-4356-9568-2133a696b40d service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:54.927483 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-91dc83e1-d7a3-4eda-a6df-b4c749ef4c0e req-ff89e12b-5d63-4356-9568-2133a696b40d service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:54.946355 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-91dc83e1-d7a3-4eda-a6df-b4c749ef4c0e req-ff89e12b-5d63-4356-9568-2133a696b40d service nova] Creating event network-vif-plugged:46e7bd28-a5a1-4c48-aa21-1a4902096c91 for instance 0396f5e6-1b64-4b0f-9352-28165af5878b on hv-cinder-82660 Aug 04 10:25:54.952591 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-91dc83e1-d7a3-4eda-a6df-b4c749ef4c0e req-ff89e12b-5d63-4356-9568-2133a696b40d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043700 Aug 04 10:25:54.953814 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 47/101] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:25:55.003210 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e3030e49-98f7-4e63-b3db-5ced04791e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:55.004183 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e3030e49-98f7-4e63-b3db-5ced04791e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:55.010890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e3030e49-98f7-4e63-b3db-5ced04791e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:55.011641 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e3030e49-98f7-4e63-b3db-5ced04791e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:55.012665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e3030e49-98f7-4e63-b3db-5ced04791e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:55.013288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e3030e49-98f7-4e63-b3db-5ced04791e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:55.093927 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8bd8c4e4-f475-4552-a3ca-0e8a2e039513 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:55.102337 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8bd8c4e4-f475-4552-a3ca-0e8a2e039513 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:55.117134 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8bd8c4e4-f475-4552-a3ca-0e8a2e039513 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:55.117949 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8bd8c4e4-f475-4552-a3ca-0e8a2e039513 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:55.118922 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8bd8c4e4-f475-4552-a3ca-0e8a2e039513 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:55.120467 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8bd8c4e4-f475-4552-a3ca-0e8a2e039513 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:55.407834 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e3030e49-98f7-4e63-b3db-5ced04791e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:55.427871 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e3030e49-98f7-4e63-b3db-5ced04791e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:55.432087 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e3030e49-98f7-4e63-b3db-5ced04791e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:55.434634 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e3030e49-98f7-4e63-b3db-5ced04791e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1406 microversion: 2.20 time: 0.435834 Aug 04 10:25:55.436575 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 55/102] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:25:54 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1406 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:25:55.479045 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cb9eec9d-5dcf-4197-8182-92c688855723 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:55.479760 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-cb9eec9d-5dcf-4197-8182-92c688855723 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:55.485655 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8bd8c4e4-f475-4552-a3ca-0e8a2e039513 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:55.489144 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb9eec9d-5dcf-4197-8182-92c688855723 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:55.489585 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb9eec9d-5dcf-4197-8182-92c688855723 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:55.495037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb9eec9d-5dcf-4197-8182-92c688855723 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:55.495413 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb9eec9d-5dcf-4197-8182-92c688855723 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:55.495590 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8bd8c4e4-f475-4552-a3ca-0e8a2e039513 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1502 microversion: 2.1 time: 0.416331 Aug 04 10:25:55.496733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 48/103] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:55 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1502 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:55.825194 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a5cdbd77-bfd5-4634-ab2b-dcf1982ae981 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:55.825727 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a5cdbd77-bfd5-4634-ab2b-dcf1982ae981 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:55.835525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a5cdbd77-bfd5-4634-ab2b-dcf1982ae981 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:55.836004 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a5cdbd77-bfd5-4634-ab2b-dcf1982ae981 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:55.836777 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a5cdbd77-bfd5-4634-ab2b-dcf1982ae981 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:55.837216 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a5cdbd77-bfd5-4634-ab2b-dcf1982ae981 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:55.851655 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-cb9eec9d-5dcf-4197-8182-92c688855723 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:55.862027 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-cb9eec9d-5dcf-4197-8182-92c688855723 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1361 microversion: 2.1 time: 0.389042 Aug 04 10:25:55.868058 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 56/104] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:55 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1361 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:25:55.879972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-64315873-5cd0-4e36-b361-8cb3685859ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:55.880605 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-64315873-5cd0-4e36-b361-8cb3685859ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:55.895622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-64315873-5cd0-4e36-b361-8cb3685859ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:55.896366 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-64315873-5cd0-4e36-b361-8cb3685859ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:55.897325 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-64315873-5cd0-4e36-b361-8cb3685859ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:55.897913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-64315873-5cd0-4e36-b361-8cb3685859ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:56.229132 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-64315873-5cd0-4e36-b361-8cb3685859ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:56.240294 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-64315873-5cd0-4e36-b361-8cb3685859ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1516 microversion: 2.1 time: 0.363243 Aug 04 10:25:56.241389 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 57/105] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:55 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1516 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:25:56.259270 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a5cdbd77-bfd5-4634-ab2b-dcf1982ae981 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:56.266795 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a969136c-c0c0-4e3b-aedb-45c84f76abd6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:56.267270 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a5cdbd77-bfd5-4634-ab2b-dcf1982ae981 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1366 microversion: 2.1 time: 0.446988 Aug 04 10:25:56.275354 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 49/106] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:55 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:56.275451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a969136c-c0c0-4e3b-aedb-45c84f76abd6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:56.282825 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a969136c-c0c0-4e3b-aedb-45c84f76abd6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:56.283494 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a969136c-c0c0-4e3b-aedb-45c84f76abd6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:56.284366 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a969136c-c0c0-4e3b-aedb-45c84f76abd6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:56.284937 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a969136c-c0c0-4e3b-aedb-45c84f76abd6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:56.365048 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-a969136c-c0c0-4e3b-aedb-45c84f76abd6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lazy-loading 'flavor' on Instance uuid d78fe279-9634-4426-8cab-5995ab7707a4 {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:25:56.460239 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-172ff0bc-d70a-4284-b6d3-d21d57f874bf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:56.461072 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-172ff0bc-d70a-4284-b6d3-d21d57f874bf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:56.469012 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-172ff0bc-d70a-4284-b6d3-d21d57f874bf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:56.471935 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-172ff0bc-d70a-4284-b6d3-d21d57f874bf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:56.472843 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-172ff0bc-d70a-4284-b6d3-d21d57f874bf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:56.473301 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-172ff0bc-d70a-4284-b6d3-d21d57f874bf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:56.501090 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a969136c-c0c0-4e3b-aedb-45c84f76abd6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "POST /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4/action" status: 200 len: 32 microversion: 2.1 time: 0.242450 Aug 04 10:25:56.506052 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 58/107] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:25:56 2022] POST /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4/action => generated 32 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:25:56.512305 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d1f23f4e-6c7f-4451-b62b-1b4d92fd722a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:56.513005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d1f23f4e-6c7f-4451-b62b-1b4d92fd722a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:56.521401 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d1f23f4e-6c7f-4451-b62b-1b4d92fd722a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:56.521792 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d1f23f4e-6c7f-4451-b62b-1b4d92fd722a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:56.522617 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d1f23f4e-6c7f-4451-b62b-1b4d92fd722a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:56.523060 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d1f23f4e-6c7f-4451-b62b-1b4d92fd722a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:56.694139 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-172ff0bc-d70a-4284-b6d3-d21d57f874bf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:56.709809 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-172ff0bc-d70a-4284-b6d3-d21d57f874bf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:56.711945 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-172ff0bc-d70a-4284-b6d3-d21d57f874bf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:56.713713 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-172ff0bc-d70a-4284-b6d3-d21d57f874bf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1406 microversion: 2.20 time: 0.258324 Aug 04 10:25:56.714637 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 50/108] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:25:56 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:25:56.717541 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d1f23f4e-6c7f-4451-b62b-1b4d92fd722a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:56.728311 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d1f23f4e-6c7f-4451-b62b-1b4d92fd722a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.220375 Aug 04 10:25:56.729289 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 59/109] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:56 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:56.889273 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-2b11e00e-0128-4ada-b707-de97bf5e06b5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:56.890057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-2b11e00e-0128-4ada-b707-de97bf5e06b5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:56.897317 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2b11e00e-0128-4ada-b707-de97bf5e06b5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:56.898085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2b11e00e-0128-4ada-b707-de97bf5e06b5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:56.898859 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2b11e00e-0128-4ada-b707-de97bf5e06b5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:56.899459 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2b11e00e-0128-4ada-b707-de97bf5e06b5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:57.066475 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-2b11e00e-0128-4ada-b707-de97bf5e06b5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:57.079583 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-2b11e00e-0128-4ada-b707-de97bf5e06b5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1361 microversion: 2.1 time: 0.193247 Aug 04 10:25:57.080583 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 51/110] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:56 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:57.292116 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4006cece-8c1a-4723-8ad1-65a1bc34654a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:57.294232 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4006cece-8c1a-4723-8ad1-65a1bc34654a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:57.307040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4006cece-8c1a-4723-8ad1-65a1bc34654a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:57.307763 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4006cece-8c1a-4723-8ad1-65a1bc34654a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:57.309222 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4006cece-8c1a-4723-8ad1-65a1bc34654a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:57.309837 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4006cece-8c1a-4723-8ad1-65a1bc34654a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:57.487775 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4006cece-8c1a-4723-8ad1-65a1bc34654a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:57.498386 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4006cece-8c1a-4723-8ad1-65a1bc34654a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1366 microversion: 2.1 time: 0.211670 Aug 04 10:25:57.499668 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 60/111] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:57 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:57.738184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8ae2b81e-a2ba-42e6-bccb-57fe9fb7dcf1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:57.739214 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8ae2b81e-a2ba-42e6-bccb-57fe9fb7dcf1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:57.747981 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8ae2b81e-a2ba-42e6-bccb-57fe9fb7dcf1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:57.748481 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8ae2b81e-a2ba-42e6-bccb-57fe9fb7dcf1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:57.749509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8ae2b81e-a2ba-42e6-bccb-57fe9fb7dcf1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:57.750439 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8ae2b81e-a2ba-42e6-bccb-57fe9fb7dcf1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:57.753936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9292d072-407c-4275-bee7-d9071b44dec1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:57.754660 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9292d072-407c-4275-bee7-d9071b44dec1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:57.765353 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9292d072-407c-4275-bee7-d9071b44dec1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:57.765718 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9292d072-407c-4275-bee7-d9071b44dec1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:57.766483 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9292d072-407c-4275-bee7-d9071b44dec1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:57.766912 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9292d072-407c-4275-bee7-d9071b44dec1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:57.984098 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9292d072-407c-4275-bee7-d9071b44dec1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:58.001863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9292d072-407c-4275-bee7-d9071b44dec1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.255591 Aug 04 10:25:58.002736 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 61/112] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:57 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:25:58.030926 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8ae2b81e-a2ba-42e6-bccb-57fe9fb7dcf1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:58.041508 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8ae2b81e-a2ba-42e6-bccb-57fe9fb7dcf1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:58.043179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8ae2b81e-a2ba-42e6-bccb-57fe9fb7dcf1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:58.046766 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8ae2b81e-a2ba-42e6-bccb-57fe9fb7dcf1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1406 microversion: 2.20 time: 0.312852 Aug 04 10:25:58.048131 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 52/113] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:25:57 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:25:58.103789 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e43b02b8-c411-4dac-b889-2b4052de33c7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:58.104676 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e43b02b8-c411-4dac-b889-2b4052de33c7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:58.111899 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e43b02b8-c411-4dac-b889-2b4052de33c7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:58.112508 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e43b02b8-c411-4dac-b889-2b4052de33c7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:58.113287 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e43b02b8-c411-4dac-b889-2b4052de33c7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:58.113720 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e43b02b8-c411-4dac-b889-2b4052de33c7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:58.258983 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e43b02b8-c411-4dac-b889-2b4052de33c7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:58.273975 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e43b02b8-c411-4dac-b889-2b4052de33c7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1361 microversion: 2.1 time: 0.176248 Aug 04 10:25:58.274881 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 62/114] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:58 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:58.519103 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b6fdd513-1c1d-4e20-adec-58c903cb2efc tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:58.519942 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b6fdd513-1c1d-4e20-adec-58c903cb2efc tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:58.526927 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b6fdd513-1c1d-4e20-adec-58c903cb2efc tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:58.527834 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b6fdd513-1c1d-4e20-adec-58c903cb2efc tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:58.528941 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b6fdd513-1c1d-4e20-adec-58c903cb2efc tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:58.529995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b6fdd513-1c1d-4e20-adec-58c903cb2efc tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:58.930510 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-16447238-0fb0-444d-9091-62b16ceb11cd req-536e9d55-7eed-40fe-b98f-6e548213821f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d55a58c-f47e-4284-9ffa-f7fb642845fb", "name": "network-vif-plugged", "status": "completed", "tag": "a1ddb5a5-2348-4975-a3d0-581514d978c0"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:58.947438 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-16447238-0fb0-444d-9091-62b16ceb11cd req-536e9d55-7eed-40fe-b98f-6e548213821f service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:58.948568 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-16447238-0fb0-444d-9091-62b16ceb11cd req-536e9d55-7eed-40fe-b98f-6e548213821f service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:58.968196 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-16447238-0fb0-444d-9091-62b16ceb11cd req-536e9d55-7eed-40fe-b98f-6e548213821f service nova] Creating event network-vif-plugged:a1ddb5a5-2348-4975-a3d0-581514d978c0 for instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb on hv-cinder-82660 Aug 04 10:25:58.971195 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b6fdd513-1c1d-4e20-adec-58c903cb2efc tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:58.976866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-16447238-0fb0-444d-9091-62b16ceb11cd req-536e9d55-7eed-40fe-b98f-6e548213821f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054591 Aug 04 10:25:58.978314 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 63/115] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:25:58.979618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b6fdd513-1c1d-4e20-adec-58c903cb2efc tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1366 microversion: 2.1 time: 0.464233 Aug 04 10:25:58.980542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 53/116] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:58 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1366 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:59.023997 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a0da0111-0946-408f-b2b0-4c382b3cb961 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:59.024262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a0da0111-0946-408f-b2b0-4c382b3cb961 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:59.032309 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a0da0111-0946-408f-b2b0-4c382b3cb961 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:59.033262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a0da0111-0946-408f-b2b0-4c382b3cb961 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:59.034044 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a0da0111-0946-408f-b2b0-4c382b3cb961 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:59.034502 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a0da0111-0946-408f-b2b0-4c382b3cb961 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:59.051798 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:59.070274 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-084172ea-2b96-47ca-a3aa-e14b778c8dac tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:59.071076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-084172ea-2b96-47ca-a3aa-e14b778c8dac tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:59.080267 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-084172ea-2b96-47ca-a3aa-e14b778c8dac tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:59.081579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-084172ea-2b96-47ca-a3aa-e14b778c8dac tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:59.081860 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-084172ea-2b96-47ca-a3aa-e14b778c8dac tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:59.082297 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-084172ea-2b96-47ca-a3aa-e14b778c8dac tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:59.255043 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a0da0111-0946-408f-b2b0-4c382b3cb961 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:59.262587 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a0da0111-0946-408f-b2b0-4c382b3cb961 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.243475 Aug 04 10:25:59.269728 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 64/117] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:59 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:25:59.292823 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-084172ea-2b96-47ca-a3aa-e14b778c8dac tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:59.294721 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-dabac304-a673-4039-9b62-86d2147be702 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:59.295362 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-dabac304-a673-4039-9b62-86d2147be702 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:59.302340 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dabac304-a673-4039-9b62-86d2147be702 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:59.302787 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dabac304-a673-4039-9b62-86d2147be702 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:59.303188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-084172ea-2b96-47ca-a3aa-e14b778c8dac tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:59.303554 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dabac304-a673-4039-9b62-86d2147be702 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:59.304003 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dabac304-a673-4039-9b62-86d2147be702 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:59.304734 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-084172ea-2b96-47ca-a3aa-e14b778c8dac tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:59.305873 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-084172ea-2b96-47ca-a3aa-e14b778c8dac tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1406 microversion: 2.20 time: 0.239594 Aug 04 10:25:59.308989 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 54/118] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:25:59 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:25:59.400803 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6da2f082-7ce8-44fd-b9f3-5805bb676537 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceb6610b-651b-433b-98db-d0a80cf3fdb1"}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:59.403388 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6da2f082-7ce8-44fd-b9f3-5805bb676537 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:25:59.411088 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6da2f082-7ce8-44fd-b9f3-5805bb676537 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:59.411531 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6da2f082-7ce8-44fd-b9f3-5805bb676537 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:59.412348 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6da2f082-7ce8-44fd-b9f3-5805bb676537 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:25:59.412782 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6da2f082-7ce8-44fd-b9f3-5805bb676537 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:25:59.453348 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-dabac304-a673-4039-9b62-86d2147be702 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:25:59.464094 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-dabac304-a673-4039-9b62-86d2147be702 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1361 microversion: 2.1 time: 0.172549 Aug 04 10:25:59.465140 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 65/119] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:59 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:00.002710 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b3b54036-4d05-4805-9fcb-fe40f35d7887 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:00.003451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b3b54036-4d05-4805-9fcb-fe40f35d7887 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:00.015025 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3b54036-4d05-4805-9fcb-fe40f35d7887 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:00.015577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3b54036-4d05-4805-9fcb-fe40f35d7887 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:00.017854 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3b54036-4d05-4805-9fcb-fe40f35d7887 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:00.019698 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3b54036-4d05-4805-9fcb-fe40f35d7887 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:00.284838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b3b54036-4d05-4805-9fcb-fe40f35d7887 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:00.294606 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b3b54036-4d05-4805-9fcb-fe40f35d7887 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1366 microversion: 2.1 time: 0.296878 Aug 04 10:26:00.295138 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 66/120] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:25:59 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:00.305563 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-37ad9381-7688-49fa-95c7-cbebaf3bfa97 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:00.307067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-37ad9381-7688-49fa-95c7-cbebaf3bfa97 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:00.319092 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37ad9381-7688-49fa-95c7-cbebaf3bfa97 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:00.319570 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37ad9381-7688-49fa-95c7-cbebaf3bfa97 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:00.320353 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37ad9381-7688-49fa-95c7-cbebaf3bfa97 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:00.320789 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37ad9381-7688-49fa-95c7-cbebaf3bfa97 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:00.406104 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=4 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:00.503386 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-37ad9381-7688-49fa-95c7-cbebaf3bfa97 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:00.512936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-37ad9381-7688-49fa-95c7-cbebaf3bfa97 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.215914 Aug 04 10:26:00.513562 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 67/121] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:00 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:00.520143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c95b15b9-6655-4e79-952e-b9b491d8cdd9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:00.520143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c95b15b9-6655-4e79-952e-b9b491d8cdd9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:00.525710 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c95b15b9-6655-4e79-952e-b9b491d8cdd9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:00.528216 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c95b15b9-6655-4e79-952e-b9b491d8cdd9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:00.529242 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c95b15b9-6655-4e79-952e-b9b491d8cdd9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:00.530344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c95b15b9-6655-4e79-952e-b9b491d8cdd9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:00.689008 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c95b15b9-6655-4e79-952e-b9b491d8cdd9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:00.698270 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c95b15b9-6655-4e79-952e-b9b491d8cdd9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:00.699768 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c95b15b9-6655-4e79-952e-b9b491d8cdd9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:00.700941 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c95b15b9-6655-4e79-952e-b9b491d8cdd9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1599 microversion: 2.20 time: 0.185966 Aug 04 10:26:00.701489 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 68/122] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:26:00 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1599 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:26:00.709672 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-405a21b5-5f02-4dcc-8974-2a46a94a08ec tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:00.710713 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-405a21b5-5f02-4dcc-8974-2a46a94a08ec tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:00.718431 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-405a21b5-5f02-4dcc-8974-2a46a94a08ec tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:00.718583 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-405a21b5-5f02-4dcc-8974-2a46a94a08ec tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:00.719244 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-405a21b5-5f02-4dcc-8974-2a46a94a08ec tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:00.720475 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-405a21b5-5f02-4dcc-8974-2a46a94a08ec tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:00.903129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-405a21b5-5f02-4dcc-8974-2a46a94a08ec tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:00.914583 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-405a21b5-5f02-4dcc-8974-2a46a94a08ec tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1361 microversion: 2.1 time: 0.210533 Aug 04 10:26:00.919842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 69/123] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:00 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:00.938275 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-15b49b34-6598-4906-b6e1-3f5ed361c857 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:00.938838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-15b49b34-6598-4906-b6e1-3f5ed361c857 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:00.949188 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-15b49b34-6598-4906-b6e1-3f5ed361c857 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:00.949638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-15b49b34-6598-4906-b6e1-3f5ed361c857 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:00.950598 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-15b49b34-6598-4906-b6e1-3f5ed361c857 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:00.951038 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-15b49b34-6598-4906-b6e1-3f5ed361c857 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:01.048884 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-15b49b34-6598-4906-b6e1-3f5ed361c857 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.127873 Aug 04 10:26:01.056697 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 70/124] 10.222.0.72 () {60 vars in 1316 bytes} [Thu Aug 4 10:26:00 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:26:01.106287 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6da2f082-7ce8-44fd-b9f3-5805bb676537 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "POST /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.709231 Aug 04 10:26:01.108502 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 55/125] 10.222.0.72 () {60 vars in 1323 bytes} [Thu Aug 4 10:25:59 2022] POST /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d/os-volume_attachments => generated 194 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:26:01.317243 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2f8c155f-1401-4693-9912-c669a999571b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:01.317961 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2f8c155f-1401-4693-9912-c669a999571b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:01.325825 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2f8c155f-1401-4693-9912-c669a999571b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:01.326275 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2f8c155f-1401-4693-9912-c669a999571b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:01.327551 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2f8c155f-1401-4693-9912-c669a999571b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:01.332968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2f8c155f-1401-4693-9912-c669a999571b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:01.539699 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e4af0649-c035-48f9-86ea-4847e0472ad8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:01.540394 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e4af0649-c035-48f9-86ea-4847e0472ad8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:01.559558 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e4af0649-c035-48f9-86ea-4847e0472ad8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:01.562035 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e4af0649-c035-48f9-86ea-4847e0472ad8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:01.565117 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e4af0649-c035-48f9-86ea-4847e0472ad8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:01.566222 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e4af0649-c035-48f9-86ea-4847e0472ad8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:01.798952 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2f8c155f-1401-4693-9912-c669a999571b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:01.812662 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2f8c155f-1401-4693-9912-c669a999571b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1366 microversion: 2.1 time: 0.498522 Aug 04 10:26:01.814479 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 71/126] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:01 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:01.940908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-997c96ec-18b4-4f44-b10f-dc32a9c49d01 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:01.942046 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-997c96ec-18b4-4f44-b10f-dc32a9c49d01 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:01.948714 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-997c96ec-18b4-4f44-b10f-dc32a9c49d01 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:01.949455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-997c96ec-18b4-4f44-b10f-dc32a9c49d01 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:01.950324 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-997c96ec-18b4-4f44-b10f-dc32a9c49d01 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:01.950865 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-997c96ec-18b4-4f44-b10f-dc32a9c49d01 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:02.039442 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e4af0649-c035-48f9-86ea-4847e0472ad8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:02.049682 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e4af0649-c035-48f9-86ea-4847e0472ad8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.515290 Aug 04 10:26:02.050601 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 56/127] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:01 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:02.319211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-997c96ec-18b4-4f44-b10f-dc32a9c49d01 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:02.334855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-997c96ec-18b4-4f44-b10f-dc32a9c49d01 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1548 microversion: 2.1 time: 0.397988 Aug 04 10:26:02.336924 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 72/128] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:01 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1548 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:02.362943 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5276d768-6c0e-47c9-b511-bad5ed5011b7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:02.363903 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5276d768-6c0e-47c9-b511-bad5ed5011b7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:02.372579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5276d768-6c0e-47c9-b511-bad5ed5011b7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:02.373030 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5276d768-6c0e-47c9-b511-bad5ed5011b7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:02.374454 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5276d768-6c0e-47c9-b511-bad5ed5011b7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:02.374765 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5276d768-6c0e-47c9-b511-bad5ed5011b7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:02.406673 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:02.524541 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5276d768-6c0e-47c9-b511-bad5ed5011b7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166507 Aug 04 10:26:02.532047 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 57/129] 10.222.0.72 () {58 vars in 1275 bytes} [Thu Aug 4 10:26:02 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:02.834019 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-51d6bc0e-f471-4dab-b99a-f419e10b5753 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:02.834910 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-51d6bc0e-f471-4dab-b99a-f419e10b5753 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:02.837031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:02.846576 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-51d6bc0e-f471-4dab-b99a-f419e10b5753 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:02.847033 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-51d6bc0e-f471-4dab-b99a-f419e10b5753 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:02.867049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-51d6bc0e-f471-4dab-b99a-f419e10b5753 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:02.867560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-51d6bc0e-f471-4dab-b99a-f419e10b5753 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:03.072437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dfdc28f7-d632-4f50-926a-5616dfc446f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:03.073285 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dfdc28f7-d632-4f50-926a-5616dfc446f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:03.081878 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dfdc28f7-d632-4f50-926a-5616dfc446f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:03.082687 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dfdc28f7-d632-4f50-926a-5616dfc446f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:03.084641 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dfdc28f7-d632-4f50-926a-5616dfc446f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:03.085142 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dfdc28f7-d632-4f50-926a-5616dfc446f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:03.152495 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-51d6bc0e-f471-4dab-b99a-f419e10b5753 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:03.161200 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-51d6bc0e-f471-4dab-b99a-f419e10b5753 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1366 microversion: 2.1 time: 0.331020 Aug 04 10:26:03.165078 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 73/130] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:02 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:03.306250 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-dfdc28f7-d632-4f50-926a-5616dfc446f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:03.318739 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-dfdc28f7-d632-4f50-926a-5616dfc446f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.250136 Aug 04 10:26:03.319519 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 58/131] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:03 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:03.590529 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-eed069a8-2975-4f42-8012-d105c8c99a49 req-e4dd1f40-33a9-4b09-84ff-fbbbf859410b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0396f5e6-1b64-4b0f-9352-28165af5878b", "tag": "46e7bd28-a5a1-4c48-aa21-1a4902096c91"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:03.613777 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-eed069a8-2975-4f42-8012-d105c8c99a49 req-e4dd1f40-33a9-4b09-84ff-fbbbf859410b service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:03.614429 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-eed069a8-2975-4f42-8012-d105c8c99a49 req-e4dd1f40-33a9-4b09-84ff-fbbbf859410b service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:03.633235 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-eed069a8-2975-4f42-8012-d105c8c99a49 req-e4dd1f40-33a9-4b09-84ff-fbbbf859410b service nova] Creating event network-changed:46e7bd28-a5a1-4c48-aa21-1a4902096c91 for instance 0396f5e6-1b64-4b0f-9352-28165af5878b on hv-cinder-82660 Aug 04 10:26:03.643449 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-eed069a8-2975-4f42-8012-d105c8c99a49 req-e4dd1f40-33a9-4b09-84ff-fbbbf859410b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058638 Aug 04 10:26:03.645663 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 74/132] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:04.188332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b5013d1b-e917-4fe6-86d6-dc07535aecde tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:04.189114 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b5013d1b-e917-4fe6-86d6-dc07535aecde tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:04.198921 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b5013d1b-e917-4fe6-86d6-dc07535aecde tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:04.199549 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b5013d1b-e917-4fe6-86d6-dc07535aecde tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:04.200530 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b5013d1b-e917-4fe6-86d6-dc07535aecde tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:04.201074 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b5013d1b-e917-4fe6-86d6-dc07535aecde tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:04.339034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b7743a0b-ddfc-418d-9afe-690102c47bd4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:04.339727 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b7743a0b-ddfc-418d-9afe-690102c47bd4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:04.349576 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b7743a0b-ddfc-418d-9afe-690102c47bd4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:04.351447 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b7743a0b-ddfc-418d-9afe-690102c47bd4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:04.353329 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b7743a0b-ddfc-418d-9afe-690102c47bd4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:04.356641 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b7743a0b-ddfc-418d-9afe-690102c47bd4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:04.577559 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b5013d1b-e917-4fe6-86d6-dc07535aecde tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:04.588022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b5013d1b-e917-4fe6-86d6-dc07535aecde tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1557 microversion: 2.1 time: 0.403762 Aug 04 10:26:04.590937 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 59/133] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:04 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1557 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:04.614587 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dcca6d94-69d5-43b4-8818-d354479befbd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:04.616166 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dcca6d94-69d5-43b4-8818-d354479befbd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:04.623097 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dcca6d94-69d5-43b4-8818-d354479befbd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:04.624860 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dcca6d94-69d5-43b4-8818-d354479befbd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:04.626597 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dcca6d94-69d5-43b4-8818-d354479befbd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:04.627256 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dcca6d94-69d5-43b4-8818-d354479befbd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:04.731120 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b7743a0b-ddfc-418d-9afe-690102c47bd4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:04.740066 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b7743a0b-ddfc-418d-9afe-690102c47bd4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.405123 Aug 04 10:26:04.740641 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 75/134] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:04 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:04.792375 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-dcca6d94-69d5-43b4-8818-d354479befbd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.183957 Aug 04 10:26:04.800435 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 60/135] 10.222.0.72 () {58 vars in 1275 bytes} [Thu Aug 4 10:26:04 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-interface => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:26:05.686712 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-c01fb85a-82ce-44d7-a12f-712966aeba05 req-765545b9-e10d-4e6c-93db-d14925f3dac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf60275d-fda6-4f0c-8a2f-14f85d685623", "tag": "a7f1ba8f-d703-43d1-94d9-5c0b11630a04"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:05.698875 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-c01fb85a-82ce-44d7-a12f-712966aeba05 req-765545b9-e10d-4e6c-93db-d14925f3dac6 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:05.699637 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-c01fb85a-82ce-44d7-a12f-712966aeba05 req-765545b9-e10d-4e6c-93db-d14925f3dac6 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:05.715487 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-c01fb85a-82ce-44d7-a12f-712966aeba05 req-765545b9-e10d-4e6c-93db-d14925f3dac6 service nova] Creating event network-changed:a7f1ba8f-d703-43d1-94d9-5c0b11630a04 for instance cf60275d-fda6-4f0c-8a2f-14f85d685623 on hv-cinder-82660 Aug 04 10:26:05.721717 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-c01fb85a-82ce-44d7-a12f-712966aeba05 req-765545b9-e10d-4e6c-93db-d14925f3dac6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039165 Aug 04 10:26:05.722948 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 76/136] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:05.761823 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c0d3b61a-b85b-43e5-879d-17e2533fc698 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:05.763102 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c0d3b61a-b85b-43e5-879d-17e2533fc698 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:05.771722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c0d3b61a-b85b-43e5-879d-17e2533fc698 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:05.772639 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c0d3b61a-b85b-43e5-879d-17e2533fc698 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:05.773857 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c0d3b61a-b85b-43e5-879d-17e2533fc698 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:05.774689 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c0d3b61a-b85b-43e5-879d-17e2533fc698 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:06.292871 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c0d3b61a-b85b-43e5-879d-17e2533fc698 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:06.304463 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c0d3b61a-b85b-43e5-879d-17e2533fc698 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.546908 Aug 04 10:26:06.305038 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 61/137] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:05 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:07.012130 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-9812c337-83c5-4cb3-95d3-61936ac5fa66 req-5900a503-e66c-4c0c-aa31-67f77cd4c00a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d55a58c-f47e-4284-9ffa-f7fb642845fb", "tag": "a1ddb5a5-2348-4975-a3d0-581514d978c0"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:07.028970 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-9812c337-83c5-4cb3-95d3-61936ac5fa66 req-5900a503-e66c-4c0c-aa31-67f77cd4c00a service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:07.029436 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-9812c337-83c5-4cb3-95d3-61936ac5fa66 req-5900a503-e66c-4c0c-aa31-67f77cd4c00a service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:07.050251 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-9812c337-83c5-4cb3-95d3-61936ac5fa66 req-5900a503-e66c-4c0c-aa31-67f77cd4c00a service nova] Creating event network-changed:a1ddb5a5-2348-4975-a3d0-581514d978c0 for instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb on hv-cinder-82660 Aug 04 10:26:07.062839 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-9812c337-83c5-4cb3-95d3-61936ac5fa66 req-5900a503-e66c-4c0c-aa31-67f77cd4c00a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053862 Aug 04 10:26:07.067224 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 77/138] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:07.329222 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5f97423b-54ec-49e9-a8f2-8a24d013d2d6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:07.330138 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5f97423b-54ec-49e9-a8f2-8a24d013d2d6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:07.342698 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5f97423b-54ec-49e9-a8f2-8a24d013d2d6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:07.350926 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5f97423b-54ec-49e9-a8f2-8a24d013d2d6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:07.355472 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5f97423b-54ec-49e9-a8f2-8a24d013d2d6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:07.360513 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5f97423b-54ec-49e9-a8f2-8a24d013d2d6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:07.586759 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5f97423b-54ec-49e9-a8f2-8a24d013d2d6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:07.599998 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5f97423b-54ec-49e9-a8f2-8a24d013d2d6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.273870 Aug 04 10:26:07.600656 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 62/139] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:07 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:08.632373 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-973e85a5-a5f3-4b7c-8c1f-ef6c9a300658 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:08.634417 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-973e85a5-a5f3-4b7c-8c1f-ef6c9a300658 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:08.644466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-973e85a5-a5f3-4b7c-8c1f-ef6c9a300658 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:08.645167 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-973e85a5-a5f3-4b7c-8c1f-ef6c9a300658 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:08.646094 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-973e85a5-a5f3-4b7c-8c1f-ef6c9a300658 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:08.646667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-973e85a5-a5f3-4b7c-8c1f-ef6c9a300658 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:08.838638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-973e85a5-a5f3-4b7c-8c1f-ef6c9a300658 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:08.850301 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-973e85a5-a5f3-4b7c-8c1f-ef6c9a300658 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.223807 Aug 04 10:26:08.851867 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 78/140] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:08 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:09.877343 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-75430891-ff34-45d2-aa3a-0b9e8122cb0b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:09.882501 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-75430891-ff34-45d2-aa3a-0b9e8122cb0b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:09.899423 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-75430891-ff34-45d2-aa3a-0b9e8122cb0b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:09.900695 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-75430891-ff34-45d2-aa3a-0b9e8122cb0b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:09.903060 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-75430891-ff34-45d2-aa3a-0b9e8122cb0b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:09.903900 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-75430891-ff34-45d2-aa3a-0b9e8122cb0b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:10.134070 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-75430891-ff34-45d2-aa3a-0b9e8122cb0b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:10.142281 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-75430891-ff34-45d2-aa3a-0b9e8122cb0b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.270462 Aug 04 10:26:10.142980 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 63/141] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:09 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:11.045053 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-16999160-7638-4cd2-9292-b3004ca608b4 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:11.045670 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-16999160-7638-4cd2-9292-b3004ca608b4 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:11.052560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-16999160-7638-4cd2-9292-b3004ca608b4 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:11.053002 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-16999160-7638-4cd2-9292-b3004ca608b4 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:11.053801 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-16999160-7638-4cd2-9292-b3004ca608b4 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:11.054195 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-16999160-7638-4cd2-9292-b3004ca608b4 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:11.078849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-16999160-7638-4cd2-9292-b3004ca608b4 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:26:11.165289 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6042688a-4932-4b69-a7a8-813852857088 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:11.166771 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6042688a-4932-4b69-a7a8-813852857088 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:11.169470 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-16999160-7638-4cd2-9292-b3004ca608b4 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 204 len: 0 microversion: 2.1 time: 0.128230 Aug 04 10:26:11.170217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 79/142] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:26:11 2022] DELETE /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:26:11.175735 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6042688a-4932-4b69-a7a8-813852857088 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:11.176303 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6042688a-4932-4b69-a7a8-813852857088 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:11.177111 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6042688a-4932-4b69-a7a8-813852857088 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:11.177568 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6042688a-4932-4b69-a7a8-813852857088 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:11.181152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-215976a4-64a6-47c0-a30e-c5d21d6f3738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:11.182908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-215976a4-64a6-47c0-a30e-c5d21d6f3738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:11.191641 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-215976a4-64a6-47c0-a30e-c5d21d6f3738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:11.192137 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-215976a4-64a6-47c0-a30e-c5d21d6f3738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:11.192909 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-215976a4-64a6-47c0-a30e-c5d21d6f3738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:11.193474 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-215976a4-64a6-47c0-a30e-c5d21d6f3738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:11.418702 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6042688a-4932-4b69-a7a8-813852857088 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:11.429671 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6042688a-4932-4b69-a7a8-813852857088 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.269212 Aug 04 10:26:11.430520 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 64/143] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:11 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:11.450424 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-215976a4-64a6-47c0-a30e-c5d21d6f3738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:11.460501 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-215976a4-64a6-47c0-a30e-c5d21d6f3738 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1554 microversion: 2.1 time: 0.284305 Aug 04 10:26:11.461266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 80/144] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:11 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1554 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:12.058238 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1311262851", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "networks": [{"uuid": "9623a600-2b81-424f-99a5-00538a69574c"}]}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:12.066976 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:12.115943 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.network.neutron [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] validate_networks() for [('9623a600-2b81-424f-99a5-00538a69574c', None, None, None, None, None)] {{(pid=117667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:26:12.451402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e4ed43d9-fd6f-43a3-a9af-f7a6e95bb30c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:12.452305 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e4ed43d9-fd6f-43a3-a9af-f7a6e95bb30c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:12.460384 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e4ed43d9-fd6f-43a3-a9af-f7a6e95bb30c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:12.461322 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e4ed43d9-fd6f-43a3-a9af-f7a6e95bb30c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:12.462877 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e4ed43d9-fd6f-43a3-a9af-f7a6e95bb30c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:12.463417 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e4ed43d9-fd6f-43a3-a9af-f7a6e95bb30c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:12.514855 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Flavor limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:26:12.515605 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Image limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:26:12.516181 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Flavor pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:26:12.516673 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Image pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:26:12.517149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:26:12.526316 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:12.526914 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:12.527850 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:12.528411 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:12.549602 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Getting quotas for project fcc945cdc83549c3833b0e39a9496e26. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:26:12.561657 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Getting quotas for user 1a7627957f0c489ebf27dcab206542ef and project fcc945cdc83549c3833b0e39a9496e26. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:26:12.575115 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Going to run 1 instances... {{(pid=117667) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:26:12.578146 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:26:12.637801 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6c620f09-f05e-42a9-abb9-6788ef3d2163 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583759 Aug 04 10:26:12.638670 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 65/145] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:26:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:26:12.644690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-370363a0-ee84-4a8b-8ff9-e59e66f50114 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:12.646545 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-370363a0-ee84-4a8b-8ff9-e59e66f50114 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:12.655068 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-370363a0-ee84-4a8b-8ff9-e59e66f50114 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:12.656667 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-370363a0-ee84-4a8b-8ff9-e59e66f50114 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:12.657976 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-370363a0-ee84-4a8b-8ff9-e59e66f50114 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:12.658597 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-370363a0-ee84-4a8b-8ff9-e59e66f50114 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:12.673924 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e4ed43d9-fd6f-43a3-a9af-f7a6e95bb30c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:12.676369 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:12.690387 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e4ed43d9-fd6f-43a3-a9af-f7a6e95bb30c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.243281 Aug 04 10:26:12.700561 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 81/146] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:12 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:12.709980 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fe1ababb-c817-43b3-9156-629807778d33 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:12.711685 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fe1ababb-c817-43b3-9156-629807778d33 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:12.828674 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fe1ababb-c817-43b3-9156-629807778d33 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:12.870153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fe1ababb-c817-43b3-9156-629807778d33 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1214 microversion: 2.1 time: 0.167530 Aug 04 10:26:12.871124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 82/147] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:12 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:12.976313 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-370363a0-ee84-4a8b-8ff9-e59e66f50114 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:12.985823 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-370363a0-ee84-4a8b-8ff9-e59e66f50114 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1554 microversion: 2.1 time: 0.345768 Aug 04 10:26:12.993972 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 66/148] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:12 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1554 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:13.713519 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bd6b9356-6dc0-4d41-ad12-02f60d10d662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:13.714128 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bd6b9356-6dc0-4d41-ad12-02f60d10d662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:13.720709 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bd6b9356-6dc0-4d41-ad12-02f60d10d662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:13.721152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bd6b9356-6dc0-4d41-ad12-02f60d10d662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:13.721909 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bd6b9356-6dc0-4d41-ad12-02f60d10d662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:13.722340 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bd6b9356-6dc0-4d41-ad12-02f60d10d662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:13.875937 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bd6b9356-6dc0-4d41-ad12-02f60d10d662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:13.884212 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bd6b9356-6dc0-4d41-ad12-02f60d10d662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.174816 Aug 04 10:26:13.884769 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 83/149] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:13 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:13.893806 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8b30305b-c670-40f1-8efa-9e2eb492f4c0 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:13.894415 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8b30305b-c670-40f1-8efa-9e2eb492f4c0 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:13.901568 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8b30305b-c670-40f1-8efa-9e2eb492f4c0 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:13.901937 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8b30305b-c670-40f1-8efa-9e2eb492f4c0 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:13.902701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8b30305b-c670-40f1-8efa-9e2eb492f4c0 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:13.903162 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8b30305b-c670-40f1-8efa-9e2eb492f4c0 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:13.971938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8b30305b-c670-40f1-8efa-9e2eb492f4c0 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:13.979630 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8b30305b-c670-40f1-8efa-9e2eb492f4c0 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1266 microversion: 2.1 time: 0.090193 Aug 04 10:26:13.980511 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 67/150] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:13 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:14.012810 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-95d27803-9ff7-4e8e-9541-e63759db2107 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:14.013426 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-95d27803-9ff7-4e8e-9541-e63759db2107 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:14.021695 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-95d27803-9ff7-4e8e-9541-e63759db2107 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:14.022144 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-95d27803-9ff7-4e8e-9541-e63759db2107 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:14.023229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-95d27803-9ff7-4e8e-9541-e63759db2107 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:14.024470 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-95d27803-9ff7-4e8e-9541-e63759db2107 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:14.283649 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-95d27803-9ff7-4e8e-9541-e63759db2107 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:14.318139 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-95d27803-9ff7-4e8e-9541-e63759db2107 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1554 microversion: 2.1 time: 0.293641 Aug 04 10:26:14.319094 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 84/151] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:14 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1554 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:14.906678 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-daea13e5-6395-497c-97d3-0f17f3c35114 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:14.907861 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-daea13e5-6395-497c-97d3-0f17f3c35114 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:14.927559 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-daea13e5-6395-497c-97d3-0f17f3c35114 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:14.928028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-daea13e5-6395-497c-97d3-0f17f3c35114 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:14.928811 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-daea13e5-6395-497c-97d3-0f17f3c35114 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:14.929242 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-daea13e5-6395-497c-97d3-0f17f3c35114 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:15.004818 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a185f71f-0b4b-40f7-b7a7-002cb8254444 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:15.005649 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a185f71f-0b4b-40f7-b7a7-002cb8254444 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:15.034039 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a185f71f-0b4b-40f7-b7a7-002cb8254444 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:15.038962 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a185f71f-0b4b-40f7-b7a7-002cb8254444 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:15.040124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a185f71f-0b4b-40f7-b7a7-002cb8254444 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:15.043033 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a185f71f-0b4b-40f7-b7a7-002cb8254444 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:15.170743 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a185f71f-0b4b-40f7-b7a7-002cb8254444 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:15.181861 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a185f71f-0b4b-40f7-b7a7-002cb8254444 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1272 microversion: 2.1 time: 0.184765 Aug 04 10:26:15.182444 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 85/152] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:14 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:15.201506 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-ccedde72-4994-4375-83e6-dc7410eb11f5 req-2620469e-826a-4a19-9ef6-7c051105b2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acb9a2a-4373-41f0-906f-874d170c717d", "name": "network-vif-deleted", "tag": "d75794c3-9edf-4849-a7f5-949dab1d0943"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:15.212123 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-ccedde72-4994-4375-83e6-dc7410eb11f5 req-2620469e-826a-4a19-9ef6-7c051105b2c6 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:15.213043 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-ccedde72-4994-4375-83e6-dc7410eb11f5 req-2620469e-826a-4a19-9ef6-7c051105b2c6 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:15.225208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-ccedde72-4994-4375-83e6-dc7410eb11f5 req-2620469e-826a-4a19-9ef6-7c051105b2c6 service nova] Creating event network-vif-deleted:d75794c3-9edf-4849-a7f5-949dab1d0943 for instance 0acb9a2a-4373-41f0-906f-874d170c717d on hv-cinder-82660 Aug 04 10:26:15.230941 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-ccedde72-4994-4375-83e6-dc7410eb11f5 req-2620469e-826a-4a19-9ef6-7c051105b2c6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033635 Aug 04 10:26:15.232068 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 86/153] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:15.267533 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-daea13e5-6395-497c-97d3-0f17f3c35114 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:15.275849 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-daea13e5-6395-497c-97d3-0f17f3c35114 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.374040 Aug 04 10:26:15.276494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 68/154] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:14 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:15.342982 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e0998ec6-27e2-4645-a0b1-d373d0f30644 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:15.344637 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e0998ec6-27e2-4645-a0b1-d373d0f30644 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:15.352835 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0998ec6-27e2-4645-a0b1-d373d0f30644 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:15.353639 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0998ec6-27e2-4645-a0b1-d373d0f30644 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:15.354755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0998ec6-27e2-4645-a0b1-d373d0f30644 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:15.355418 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0998ec6-27e2-4645-a0b1-d373d0f30644 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:15.426891 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e0998ec6-27e2-4645-a0b1-d373d0f30644 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532df9b1c22b4b0c9237bb0a36044c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48cfdacb9c44bdd9fe7df95ee93f65b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:15.435945 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e0998ec6-27e2-4645-a0b1-d373d0f30644 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 200 len: 1346 microversion: 2.1 time: 0.096997 Aug 04 10:26:15.436931 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 87/155] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:15 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 1346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:16.202992 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4231deb6-22ea-459f-96ef-fb2b4f155cd3 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:16.203574 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4231deb6-22ea-459f-96ef-fb2b4f155cd3 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:16.210161 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4231deb6-22ea-459f-96ef-fb2b4f155cd3 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:16.210606 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4231deb6-22ea-459f-96ef-fb2b4f155cd3 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:16.211370 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4231deb6-22ea-459f-96ef-fb2b4f155cd3 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:16.211787 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4231deb6-22ea-459f-96ef-fb2b4f155cd3 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:16.298681 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-47a4e5f9-54ac-401d-8064-005a4d680e75 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:16.299392 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-47a4e5f9-54ac-401d-8064-005a4d680e75 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:16.305613 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-47a4e5f9-54ac-401d-8064-005a4d680e75 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:16.306306 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-47a4e5f9-54ac-401d-8064-005a4d680e75 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:16.307078 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-47a4e5f9-54ac-401d-8064-005a4d680e75 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:16.307671 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-47a4e5f9-54ac-401d-8064-005a4d680e75 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:16.355524 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4231deb6-22ea-459f-96ef-fb2b4f155cd3 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:16.366179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4231deb6-22ea-459f-96ef-fb2b4f155cd3 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1314 microversion: 2.1 time: 0.167202 Aug 04 10:26:16.367154 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 69/156] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:16 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:16.458755 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9587c823-8238-4a0e-a953-82952244b0ac tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:16.461192 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9587c823-8238-4a0e-a953-82952244b0ac tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:16.466521 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-47a4e5f9-54ac-401d-8064-005a4d680e75 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:16.469076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9587c823-8238-4a0e-a953-82952244b0ac tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:16.469530 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9587c823-8238-4a0e-a953-82952244b0ac tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:16.470293 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9587c823-8238-4a0e-a953-82952244b0ac tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:16.470892 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9587c823-8238-4a0e-a953-82952244b0ac tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:16.474754 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-47a4e5f9-54ac-401d-8064-005a4d680e75 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.181165 Aug 04 10:26:16.475410 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 88/157] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:16 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:16.485791 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-9587c823-8238-4a0e-a953-82952244b0ac tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] HTTP exception thrown: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9587c823-8238-4a0e-a953-82952244b0ac tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Request method failure captured: Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d HTTP/1.1 Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656RcWSuF9MFGtZtoOF0D7LLPyoupjF-YwHTVOglIfq2OGNqVKeyXZsHBKNMqQXffbpsxmjkJkwUSA98V1OcSG1YAd74Y-UrYay-x_OMP68S3tuDjVstZHSpQBjXQL7SZRcZaVnmqlE9zQ8ywJLUnF266mZNP6G_6eSVBpzKyw5vur0 Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: e48cfdacb9c44bdd9fe7df95ee93f65b Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-DeleteServersTestJSON-1159522300 Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:26:16.490367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:26:16.492106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:26:16.492106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-DeleteServersTestJSON-1159522300 Aug 04 10:26:16.492106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: e48cfdacb9c44bdd9fe7df95ee93f65b Aug 04 10:26:16.492106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-DeleteServersTestJSON-1159522300 Aug 04 10:26:16.492106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-DeleteServersTestJSON-1159522300-project Aug 04 10:26:16.492106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:26:16.492106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:26:16.492106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: 532df9b1c22b4b0c9237bb0a36044c7b Aug 04 10:26:16.492106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-DeleteServersTestJSON-1159522300-project Aug 04 10:26:16.492106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:26:16.492106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:16.492106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '0acb9a2a-4373-41f0-906f-874d170c717d'} Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:16.494008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:16.496228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:16.498660 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9587c823-8238-4a0e-a953-82952244b0ac tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Returning 404 to user: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:16.498660 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9587c823-8238-4a0e-a953-82952244b0ac tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 404 len: 111 microversion: 2.1 time: 0.038796 Aug 04 10:26:16.498660 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 70/158] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:16 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 10:26:16.612577 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ff9693f4-a410-43ca-aacb-07701ccca90b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:16.614691 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-f4a549ad-ab33-495c-8e4a-ccfa740dd2b0 req-f78bc525-e92e-4165-9b2d-ba92a90b562b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2066a3db-786e-4100-8e08-51bfff15f37c", "tag": "22fc3f38-0929-4564-a14e-3b91e2bff0ce"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:16.622928 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ff9693f4-a410-43ca-aacb-07701ccca90b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:16.633963 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ff9693f4-a410-43ca-aacb-07701ccca90b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:16.634659 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ff9693f4-a410-43ca-aacb-07701ccca90b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:16.635383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-f4a549ad-ab33-495c-8e4a-ccfa740dd2b0 req-f78bc525-e92e-4165-9b2d-ba92a90b562b service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:16.635532 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ff9693f4-a410-43ca-aacb-07701ccca90b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:16.635827 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-f4a549ad-ab33-495c-8e4a-ccfa740dd2b0 req-f78bc525-e92e-4165-9b2d-ba92a90b562b service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:16.635937 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ff9693f4-a410-43ca-aacb-07701ccca90b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:16.650951 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-ff9693f4-a410-43ca-aacb-07701ccca90b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] HTTP exception thrown: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:16.653274 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-f4a549ad-ab33-495c-8e4a-ccfa740dd2b0 req-f78bc525-e92e-4165-9b2d-ba92a90b562b service nova] Creating event network-changed:22fc3f38-0929-4564-a14e-3b91e2bff0ce for instance 2066a3db-786e-4100-8e08-51bfff15f37c on hv-cinder-82660 Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ff9693f4-a410-43ca-aacb-07701ccca90b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Request method failure captured: Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d/os-volume_attachments HTTP/1.1 Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656RcWSuF9MFGtZtoOF0D7LLPyoupjF-YwHTVOglIfq2OGNqVKeyXZsHBKNMqQXffbpsxmjkJkwUSA98V1OcSG1YAd74Y-UrYay-x_OMP68S3tuDjVstZHSpQBjXQL7SZRcZaVnmqlE9zQ8ywJLUnF266mZNP6G_6eSVBpzKyw5vur0 Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: e48cfdacb9c44bdd9fe7df95ee93f65b Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-DeleteServersTestJSON-1159522300 Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:26:16.656249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:26:16.657569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:26:16.657569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-DeleteServersTestJSON-1159522300 Aug 04 10:26:16.657569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: e48cfdacb9c44bdd9fe7df95ee93f65b Aug 04 10:26:16.657569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-DeleteServersTestJSON-1159522300 Aug 04 10:26:16.657569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-DeleteServersTestJSON-1159522300-project Aug 04 10:26:16.657569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:26:16.657569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:26:16.657569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: 532df9b1c22b4b0c9237bb0a36044c7b Aug 04 10:26:16.657569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-DeleteServersTestJSON-1159522300-project Aug 04 10:26:16.657569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:26:16.657569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:16.657569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'server_id': '0acb9a2a-4373-41f0-906f-874d170c717d'} Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:16.658188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:16.659193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:16.662299 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-f4a549ad-ab33-495c-8e4a-ccfa740dd2b0 req-f78bc525-e92e-4165-9b2d-ba92a90b562b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060014 Aug 04 10:26:16.662411 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ff9693f4-a410-43ca-aacb-07701ccca90b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Returning 404 to user: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:16.663208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 89/159] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:26:16.663607 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ff9693f4-a410-43ca-aacb-07701ccca90b tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059963 Aug 04 10:26:16.664190 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 71/160] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:26:16 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:26:17.390059 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a8c6151f-8603-4c3c-b728-a83233005ab8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:17.390746 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a8c6151f-8603-4c3c-b728-a83233005ab8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:17.397094 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a8c6151f-8603-4c3c-b728-a83233005ab8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:17.397543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a8c6151f-8603-4c3c-b728-a83233005ab8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:17.398295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a8c6151f-8603-4c3c-b728-a83233005ab8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:17.398719 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a8c6151f-8603-4c3c-b728-a83233005ab8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:17.496517 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4cfd6c85-a42f-4502-b9b7-99aa8bc17ff1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:17.497130 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4cfd6c85-a42f-4502-b9b7-99aa8bc17ff1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:17.504878 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4cfd6c85-a42f-4502-b9b7-99aa8bc17ff1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:17.505325 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4cfd6c85-a42f-4502-b9b7-99aa8bc17ff1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:17.506100 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4cfd6c85-a42f-4502-b9b7-99aa8bc17ff1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:17.506531 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4cfd6c85-a42f-4502-b9b7-99aa8bc17ff1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:17.532356 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a8c6151f-8603-4c3c-b728-a83233005ab8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:17.539922 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a8c6151f-8603-4c3c-b728-a83233005ab8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1314 microversion: 2.1 time: 0.154239 Aug 04 10:26:17.540629 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 90/161] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:17 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:17.646706 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4cfd6c85-a42f-4502-b9b7-99aa8bc17ff1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:17.654720 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4cfd6c85-a42f-4502-b9b7-99aa8bc17ff1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.162202 Aug 04 10:26:17.655398 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 72/162] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:17 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:17.888737 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-dce07259-783e-4c03-aca4-f3744a67a8d0 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:17.889232 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-dce07259-783e-4c03-aca4-f3744a67a8d0 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:17.895717 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dce07259-783e-4c03-aca4-f3744a67a8d0 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:17.896210 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dce07259-783e-4c03-aca4-f3744a67a8d0 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:17.897014 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dce07259-783e-4c03-aca4-f3744a67a8d0 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:17.897497 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dce07259-783e-4c03-aca4-f3744a67a8d0 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:17.913016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-dce07259-783e-4c03-aca4-f3744a67a8d0 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] HTTP exception thrown: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-dce07259-783e-4c03-aca4-f3744a67a8d0 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Request method failure captured: Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d HTTP/1.1 Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656RcWSuF9MFGtZtoOF0D7LLPyoupjF-YwHTVOglIfq2OGNqVKeyXZsHBKNMqQXffbpsxmjkJkwUSA98V1OcSG1YAd74Y-UrYay-x_OMP68S3tuDjVstZHSpQBjXQL7SZRcZaVnmqlE9zQ8ywJLUnF266mZNP6G_6eSVBpzKyw5vur0 Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: e48cfdacb9c44bdd9fe7df95ee93f65b Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-DeleteServersTestJSON-1159522300 Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:26:17.917665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:26:17.918988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:26:17.918988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-DeleteServersTestJSON-1159522300 Aug 04 10:26:17.918988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: e48cfdacb9c44bdd9fe7df95ee93f65b Aug 04 10:26:17.918988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-DeleteServersTestJSON-1159522300 Aug 04 10:26:17.918988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-DeleteServersTestJSON-1159522300-project Aug 04 10:26:17.918988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:26:17.918988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:26:17.918988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: 532df9b1c22b4b0c9237bb0a36044c7b Aug 04 10:26:17.918988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-DeleteServersTestJSON-1159522300-project Aug 04 10:26:17.918988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:26:17.918988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:17.918988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '0acb9a2a-4373-41f0-906f-874d170c717d'} Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:17.919608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:17.921295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:17.923073 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-dce07259-783e-4c03-aca4-f3744a67a8d0 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Returning 404 to user: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:17.923073 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-dce07259-783e-4c03-aca4-f3744a67a8d0 tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 404 len: 111 microversion: 2.1 time: 0.034303 Aug 04 10:26:17.923073 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 91/163] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:26:17 2022] DELETE /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:26:17.927777 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e980305c-f45f-4179-b9d6-d7e84b31bc0f tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:17.928432 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e980305c-f45f-4179-b9d6-d7e84b31bc0f tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] [instance: 0acb9a2a-4373-41f0-906f-874d170c717d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:17.934499 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e980305c-f45f-4179-b9d6-d7e84b31bc0f tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:17.934936 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e980305c-f45f-4179-b9d6-d7e84b31bc0f tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:17.936075 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e980305c-f45f-4179-b9d6-d7e84b31bc0f tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:17.936503 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e980305c-f45f-4179-b9d6-d7e84b31bc0f tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:17.950739 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-e980305c-f45f-4179-b9d6-d7e84b31bc0f tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] HTTP exception thrown: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e980305c-f45f-4179-b9d6-d7e84b31bc0f tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Request method failure captured: Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d HTTP/1.1 Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656RcWSuF9MFGtZtoOF0D7LLPyoupjF-YwHTVOglIfq2OGNqVKeyXZsHBKNMqQXffbpsxmjkJkwUSA98V1OcSG1YAd74Y-UrYay-x_OMP68S3tuDjVstZHSpQBjXQL7SZRcZaVnmqlE9zQ8ywJLUnF266mZNP6G_6eSVBpzKyw5vur0 Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: e48cfdacb9c44bdd9fe7df95ee93f65b Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-DeleteServersTestJSON-1159522300 Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:26:17.952282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:26:17.954464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_e48cfdacb9c44bdd9fe7df95ee93f65b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:26:17.954464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-DeleteServersTestJSON-1159522300 Aug 04 10:26:17.954464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: e48cfdacb9c44bdd9fe7df95ee93f65b Aug 04 10:26:17.954464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-DeleteServersTestJSON-1159522300 Aug 04 10:26:17.954464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-DeleteServersTestJSON-1159522300-project Aug 04 10:26:17.954464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:26:17.954464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:26:17.954464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: 532df9b1c22b4b0c9237bb0a36044c7b Aug 04 10:26:17.954464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-DeleteServersTestJSON-1159522300-project Aug 04 10:26:17.954464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:26:17.954464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:17.954464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '0acb9a2a-4373-41f0-906f-874d170c717d'} Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:17.955332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. Aug 04 10:26:17.956733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:17.957991 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e980305c-f45f-4179-b9d6-d7e84b31bc0f tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] Returning 404 to user: Instance 0acb9a2a-4373-41f0-906f-874d170c717d could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:17.957991 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e980305c-f45f-4179-b9d6-d7e84b31bc0f tempest-DeleteServersTestJSON-1159522300 tempest-DeleteServersTestJSON-1159522300-project] 10.222.0.72 "GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d" status: 404 len: 111 microversion: 2.1 time: 0.030341 Aug 04 10:26:17.957991 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 73/164] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:17 2022] GET /compute/v2.1/servers/0acb9a2a-4373-41f0-906f-874d170c717d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:26:18.562611 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-365f5b89-6706-4104-ae84-1060b2c2f52a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:18.563344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-365f5b89-6706-4104-ae84-1060b2c2f52a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:18.569766 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-365f5b89-6706-4104-ae84-1060b2c2f52a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:18.570329 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-365f5b89-6706-4104-ae84-1060b2c2f52a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:18.571311 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-365f5b89-6706-4104-ae84-1060b2c2f52a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:18.571973 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-365f5b89-6706-4104-ae84-1060b2c2f52a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:18.677128 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0161eafe-843d-45c8-a452-932c8f90e2c9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:18.678466 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0161eafe-843d-45c8-a452-932c8f90e2c9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:18.684889 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0161eafe-843d-45c8-a452-932c8f90e2c9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:18.685574 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0161eafe-843d-45c8-a452-932c8f90e2c9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:18.686540 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0161eafe-843d-45c8-a452-932c8f90e2c9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:18.687692 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0161eafe-843d-45c8-a452-932c8f90e2c9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:18.844043 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-365f5b89-6706-4104-ae84-1060b2c2f52a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:18.853853 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-365f5b89-6706-4104-ae84-1060b2c2f52a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1314 microversion: 2.1 time: 0.295578 Aug 04 10:26:18.854452 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 92/165] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:18 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:18.935473 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0161eafe-843d-45c8-a452-932c8f90e2c9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:18.951036 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0161eafe-843d-45c8-a452-932c8f90e2c9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.277585 Aug 04 10:26:18.951615 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 74/166] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:18 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:19.878748 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5972bae2-f355-4892-862f-91f0221af572 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:19.879182 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5972bae2-f355-4892-862f-91f0221af572 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:19.888198 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5972bae2-f355-4892-862f-91f0221af572 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:19.888645 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5972bae2-f355-4892-862f-91f0221af572 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:19.889409 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5972bae2-f355-4892-862f-91f0221af572 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:19.889837 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5972bae2-f355-4892-862f-91f0221af572 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:19.972914 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c973696d-15f3-4593-a5b6-778e06e2b3b1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:19.973924 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c973696d-15f3-4593-a5b6-778e06e2b3b1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:19.982468 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c973696d-15f3-4593-a5b6-778e06e2b3b1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:19.983414 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c973696d-15f3-4593-a5b6-778e06e2b3b1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:19.985246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c973696d-15f3-4593-a5b6-778e06e2b3b1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:19.986740 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c973696d-15f3-4593-a5b6-778e06e2b3b1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:20.221788 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5972bae2-f355-4892-862f-91f0221af572 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:20.231706 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5972bae2-f355-4892-862f-91f0221af572 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1314 microversion: 2.1 time: 0.360374 Aug 04 10:26:20.232332 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 93/167] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:19 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:20.287375 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c973696d-15f3-4593-a5b6-778e06e2b3b1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:20.297742 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c973696d-15f3-4593-a5b6-778e06e2b3b1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.329060 Aug 04 10:26:20.298712 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 75/168] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:19 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:21.253909 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ee600483-bfde-4ff3-b5dd-aec12a2b5469 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:21.254460 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ee600483-bfde-4ff3-b5dd-aec12a2b5469 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:21.261150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee600483-bfde-4ff3-b5dd-aec12a2b5469 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:21.262025 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee600483-bfde-4ff3-b5dd-aec12a2b5469 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:21.263031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee600483-bfde-4ff3-b5dd-aec12a2b5469 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:21.263669 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee600483-bfde-4ff3-b5dd-aec12a2b5469 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:21.319454 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-842d117f-a360-46f2-a855-80c349112aba tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:21.320888 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-842d117f-a360-46f2-a855-80c349112aba tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:21.329382 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-842d117f-a360-46f2-a855-80c349112aba tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:21.330483 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-842d117f-a360-46f2-a855-80c349112aba tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:21.331639 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-842d117f-a360-46f2-a855-80c349112aba tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:21.332988 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-842d117f-a360-46f2-a855-80c349112aba tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:21.876684 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ee600483-bfde-4ff3-b5dd-aec12a2b5469 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:21.880597 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-842d117f-a360-46f2-a855-80c349112aba tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:21.884919 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ee600483-bfde-4ff3-b5dd-aec12a2b5469 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1314 microversion: 2.1 time: 0.634831 Aug 04 10:26:21.893489 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 94/169] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:21 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:21.912062 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-842d117f-a360-46f2-a855-80c349112aba tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.595312 Aug 04 10:26:21.912062 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 76/170] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:21 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:22.914464 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2258e133-2a5a-41c8-9834-bc7e1e2def6b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:22.915605 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2258e133-2a5a-41c8-9834-bc7e1e2def6b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:22.919386 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:22.923767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2258e133-2a5a-41c8-9834-bc7e1e2def6b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:22.924559 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2258e133-2a5a-41c8-9834-bc7e1e2def6b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:22.932337 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b67f8d4a-5dd7-413c-8292-391721e6337b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:22.935324 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b67f8d4a-5dd7-413c-8292-391721e6337b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:22.939735 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:22.940172 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2258e133-2a5a-41c8-9834-bc7e1e2def6b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:22.941249 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2258e133-2a5a-41c8-9834-bc7e1e2def6b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:22.942101 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=6 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:22.953308 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b67f8d4a-5dd7-413c-8292-391721e6337b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:22.953998 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b67f8d4a-5dd7-413c-8292-391721e6337b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:22.954771 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b67f8d4a-5dd7-413c-8292-391721e6337b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:22.955212 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b67f8d4a-5dd7-413c-8292-391721e6337b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:22.978313 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=100 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:23.199462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b67f8d4a-5dd7-413c-8292-391721e6337b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:23.205759 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2258e133-2a5a-41c8-9834-bc7e1e2def6b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:23.212866 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b67f8d4a-5dd7-413c-8292-391721e6337b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.285452 Aug 04 10:26:23.213225 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2258e133-2a5a-41c8-9834-bc7e1e2def6b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1314 microversion: 2.1 time: 0.302578 Aug 04 10:26:23.214120 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 95/171] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:22 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:23.224634 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 77/172] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:22 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:23.228337 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-80de7dde-4f20-4e37-8192-37a9f1607e70 req-72159fbe-d66c-437e-aa9b-26194de3bc39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2066a3db-786e-4100-8e08-51bfff15f37c", "name": "network-vif-plugged", "status": "completed", "tag": "22fc3f38-0929-4564-a14e-3b91e2bff0ce"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:23.239112 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-80de7dde-4f20-4e37-8192-37a9f1607e70 req-72159fbe-d66c-437e-aa9b-26194de3bc39 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:23.239543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-80de7dde-4f20-4e37-8192-37a9f1607e70 req-72159fbe-d66c-437e-aa9b-26194de3bc39 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:23.257138 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-80de7dde-4f20-4e37-8192-37a9f1607e70 req-72159fbe-d66c-437e-aa9b-26194de3bc39 service nova] Creating event network-vif-plugged:22fc3f38-0929-4564-a14e-3b91e2bff0ce for instance 2066a3db-786e-4100-8e08-51bfff15f37c on hv-cinder-82660 Aug 04 10:26:23.262602 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-80de7dde-4f20-4e37-8192-37a9f1607e70 req-72159fbe-d66c-437e-aa9b-26194de3bc39 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047181 Aug 04 10:26:23.263350 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 96/173] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:24.241743 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3d8a4d56-9fda-42c7-b117-f1405b3699db tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:24.242452 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3d8a4d56-9fda-42c7-b117-f1405b3699db tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:24.265060 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3d8a4d56-9fda-42c7-b117-f1405b3699db tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:24.265517 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3d8a4d56-9fda-42c7-b117-f1405b3699db tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:24.266289 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3d8a4d56-9fda-42c7-b117-f1405b3699db tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:24.266721 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3d8a4d56-9fda-42c7-b117-f1405b3699db tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:24.286689 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-fbbcd79f-ff02-4209-8c9e-96cc9473f80d tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Action: 'create', calling method: .version_select at 0x7fbaacb33d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1422939406", "metadata": {"Type": "work"}}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-fbbcd79f-ff02-4209-8c9e-96cc9473f80d tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Request method failure captured: Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 122 Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi657QporIjSGAYbODYozlWHE6YrUAo3ttF3Rtf_kvk8MoF-fvKJeJc3hEJbC0DZ2RMItG2Kt_lJMltC68u9_MAlTWy8L_PhVj7HAWIGnIk2BP7QDlFw0H9NSFqBDiiOjhkVmm_WKDMnpL9mcPGDMSYdSUoOEwD31S_6ibLs7NZ7gcD7U Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 3eb365800c0d4213b45804c34ebbf01f Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:26:24.299409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:26:24.301220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:26:24.301220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.301220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 3eb365800c0d4213b45804c34ebbf01f Aug 04 10:26:24.301220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.301220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-VolumesNegativeTest-162121852-project Aug 04 10:26:24.301220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:26:24.301220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:26:24.301220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: e9dec61e00284c49bfd60edb7076c3a2 Aug 04 10:26:24.301220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-VolumesNegativeTest-162121852-project Aug 04 10:26:24.301220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Aug 04 10:26:24.301220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1422939406", "metadata": {"Type": "work"}}} Aug 04 10:26:24.301220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: Aug 04 10:26:24.301220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1422939406', 'metadata': {'Type': 'work'}}}} Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise error Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:24.302043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 10:26:24.303399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 10:26:24.304462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 10:26:24.304462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.304462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-fbbcd79f-ff02-4209-8c9e-96cc9473f80d tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:24.304462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-fbbcd79f-ff02-4209-8c9e-96cc9473f80d tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.154101 Aug 04 10:26:24.304462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 78/174] 10.222.0.72 () {60 vars in 1156 bytes} [Thu Aug 4 10:26:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:26:24.307009 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-699e44a0-0a7f-4866-8dd3-36b2785e0e9e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:24.307995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-699e44a0-0a7f-4866-8dd3-36b2785e0e9e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:24.315728 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-699e44a0-0a7f-4866-8dd3-36b2785e0e9e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:24.316194 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-699e44a0-0a7f-4866-8dd3-36b2785e0e9e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:24.316964 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-699e44a0-0a7f-4866-8dd3-36b2785e0e9e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:24.317394 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-699e44a0-0a7f-4866-8dd3-36b2785e0e9e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:24.496744 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3d8a4d56-9fda-42c7-b117-f1405b3699db tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:24.502037 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-699e44a0-0a7f-4866-8dd3-36b2785e0e9e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:24.505847 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3d8a4d56-9fda-42c7-b117-f1405b3699db tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.273996 Aug 04 10:26:24.506189 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 97/175] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:24 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:24.511323 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-699e44a0-0a7f-4866-8dd3-36b2785e0e9e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1314 microversion: 2.1 time: 0.208682 Aug 04 10:26:24.512038 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 79/176] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:24 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:24.512179 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ddaef5df-1f1e-4b67-8287-55693bad32b1 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Action: 'create', calling method: .version_select at 0x7fbaa5133670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-111135057", "metadata": {"Type": "work"}}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ddaef5df-1f1e-4b67-8287-55693bad32b1 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Request method failure captured: Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 119 Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi657QporIjSGAYbODYozlWHE6YrUAo3ttF3Rtf_kvk8MoF-fvKJeJc3hEJbC0DZ2RMItG2Kt_lJMltC68u9_MAlTWy8L_PhVj7HAWIGnIk2BP7QDlFw0H9NSFqBDiiOjhkVmm_WKDMnpL9mcPGDMSYdSUoOEwD31S_6ibLs7NZ7gcD7U Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 3eb365800c0d4213b45804c34ebbf01f Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:26:24.518304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:26:24.519400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:26:24.519400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.519400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 3eb365800c0d4213b45804c34ebbf01f Aug 04 10:26:24.519400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.519400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesNegativeTest-162121852-project Aug 04 10:26:24.519400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:26:24.519400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:26:24.519400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: e9dec61e00284c49bfd60edb7076c3a2 Aug 04 10:26:24.519400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesNegativeTest-162121852-project Aug 04 10:26:24.519400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Aug 04 10:26:24.519400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-111135057", "metadata": {"Type": "work"}}} Aug 04 10:26:24.519400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: Aug 04 10:26:24.519400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-111135057', 'metadata': {'Type': 'work'}}}} Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise error Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi '0' Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:24.520503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 10:26:24.521849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 10:26:24.522921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 10:26:24.522921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.522921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ddaef5df-1f1e-4b67-8287-55693bad32b1 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:24.523919 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ddaef5df-1f1e-4b67-8287-55693bad32b1 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016504 Aug 04 10:26:24.524901 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 98/177] 10.222.0.72 () {60 vars in 1156 bytes} [Thu Aug 4 10:26:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:26:24.534725 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4cd8ce7d-c0b8-4f78-a0e9-828e5fce193c tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Action: 'create', calling method: .version_select at 0x7fbaa494e790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-275532769", "metadata": {"Type": "work"}}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4cd8ce7d-c0b8-4f78-a0e9-828e5fce193c tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Request method failure captured: Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 118 Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi657QporIjSGAYbODYozlWHE6YrUAo3ttF3Rtf_kvk8MoF-fvKJeJc3hEJbC0DZ2RMItG2Kt_lJMltC68u9_MAlTWy8L_PhVj7HAWIGnIk2BP7QDlFw0H9NSFqBDiiOjhkVmm_WKDMnpL9mcPGDMSYdSUoOEwD31S_6ibLs7NZ7gcD7U Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 3eb365800c0d4213b45804c34ebbf01f Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:26:24.539397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:26:24.540764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:26:24.540764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.540764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 3eb365800c0d4213b45804c34ebbf01f Aug 04 10:26:24.540764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.540764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-VolumesNegativeTest-162121852-project Aug 04 10:26:24.540764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:26:24.540764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:26:24.540764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: e9dec61e00284c49bfd60edb7076c3a2 Aug 04 10:26:24.540764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-VolumesNegativeTest-162121852-project Aug 04 10:26:24.540764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Aug 04 10:26:24.540764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-275532769", "metadata": {"Type": "work"}}} Aug 04 10:26:24.540764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: Aug 04 10:26:24.540764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-275532769', 'metadata': {'Type': 'work'}}}} Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise error Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi '' Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:24.541582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 10:26:24.542938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 10:26:24.545424 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 10:26:24.545424 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.545424 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4cd8ce7d-c0b8-4f78-a0e9-828e5fce193c tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:24.545424 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4cd8ce7d-c0b8-4f78-a0e9-828e5fce193c tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010870 Aug 04 10:26:24.545424 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 80/178] 10.222.0.72 () {60 vars in 1156 bytes} [Thu Aug 4 10:26:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:26:24.551337 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e4034c6d-9052-4ef2-badb-6ce5b2d4f402 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Calling method '.version_select at 0x7fbaa52b7430>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:24.583230 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-e4034c6d-9052-4ef2-badb-6ce5b2d4f402 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] HTTP exception thrown: Volume tempest-invalid-554809505 could not be found. Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e4034c6d-9052-4ef2-badb-6ce5b2d4f402 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Request method failure captured: Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-554809505 HTTP/1.1 Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi657QporIjSGAYbODYozlWHE6YrUAo3ttF3Rtf_kvk8MoF-fvKJeJc3hEJbC0DZ2RMItG2Kt_lJMltC68u9_MAlTWy8L_PhVj7HAWIGnIk2BP7QDlFw0H9NSFqBDiiOjhkVmm_WKDMnpL9mcPGDMSYdSUoOEwD31S_6ibLs7NZ7gcD7U Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 3eb365800c0d4213b45804c34ebbf01f Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:26:24.585197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:26:24.586615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:26:24.586615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.586615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 3eb365800c0d4213b45804c34ebbf01f Aug 04 10:26:24.586615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.586615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesNegativeTest-162121852-project Aug 04 10:26:24.586615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:26:24.586615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:26:24.586615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: e9dec61e00284c49bfd60edb7076c3a2 Aug 04 10:26:24.586615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesNegativeTest-162121852-project Aug 04 10:26:24.586615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: Aug 04 10:26:24.586615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Volume tempest-invalid-554809505 could not be found. Aug 04 10:26:24.586615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': 'tempest-invalid-554809505'} Aug 04 10:26:24.586615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-554809505 could not be found. (HTTP 404) (Request-ID: req-2ee6f4b3-8333-465f-b4e9-9d8bb8670632) Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.587569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 10:26:24.589262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-554809505 could not be found. Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:24.590228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-554809505 could not be found. Aug 04 10:26:24.591239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.591239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.591239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.591239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.591239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:24.591239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:24.591239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:24.591239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:24.591239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-554809505 could not be found. Aug 04 10:26:24.591239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.591239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e4034c6d-9052-4ef2-badb-6ce5b2d4f402 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Returning 404 to user: Volume tempest-invalid-554809505 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:24.591239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e4034c6d-9052-4ef2-badb-6ce5b2d4f402 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/tempest-invalid-554809505" status: 404 len: 98 microversion: 2.1 time: 0.039728 Aug 04 10:26:24.591239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 99/179] 10.222.0.72 () {58 vars in 1215 bytes} [Thu Aug 4 10:26:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-554809505 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 10:26:24.598296 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-597c09d9-bad0-49c2-99c3-5bb7c7cb2e31 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003851 Aug 04 10:26:24.598801 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 81/180] 10.222.0.72 () {58 vars in 1140 bytes} [Thu Aug 4 10:26:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 10:26:24.608719 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-38638347-8df2-46b0-afcc-9ca3ea615db6 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004309 Aug 04 10:26:24.609372 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 100/181] 10.222.0.72 () {58 vars in 1137 bytes} [Thu Aug 4 10:26:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 10:26:24.624237 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4ed0020d-5c43-48bd-8fd0-1cc4c525736b tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Calling method '.version_select at 0x7fbaa4949a60>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:24.654253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-4ed0020d-5c43-48bd-8fd0-1cc4c525736b tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] HTTP exception thrown: Volume 30685eea-d0a5-4abb-95bc-519ed00ae07c could not be found. Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4ed0020d-5c43-48bd-8fd0-1cc4c525736b tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Request method failure captured: Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: DELETE /compute/v2.1/os-volumes/30685eea-d0a5-4abb-95bc-519ed00ae07c HTTP/1.1 Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi657QporIjSGAYbODYozlWHE6YrUAo3ttF3Rtf_kvk8MoF-fvKJeJc3hEJbC0DZ2RMItG2Kt_lJMltC68u9_MAlTWy8L_PhVj7HAWIGnIk2BP7QDlFw0H9NSFqBDiiOjhkVmm_WKDMnpL9mcPGDMSYdSUoOEwD31S_6ibLs7NZ7gcD7U Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 3eb365800c0d4213b45804c34ebbf01f Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:26:24.656825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:26:24.658179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:26:24.658179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.658179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 3eb365800c0d4213b45804c34ebbf01f Aug 04 10:26:24.658179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.658179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-VolumesNegativeTest-162121852-project Aug 04 10:26:24.658179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:26:24.658179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:26:24.658179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: e9dec61e00284c49bfd60edb7076c3a2 Aug 04 10:26:24.658179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-VolumesNegativeTest-162121852-project Aug 04 10:26:24.658179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: Aug 04 10:26:24.658179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Volume 30685eea-d0a5-4abb-95bc-519ed00ae07c could not be found. Aug 04 10:26:24.658179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '30685eea-d0a5-4abb-95bc-519ed00ae07c'} Aug 04 10:26:24.658179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30685eea-d0a5-4abb-95bc-519ed00ae07c could not be found. (HTTP 404) (Request-ID: req-1c005dd8-1cb9-4498-b19a-900303b37feb) Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.659020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 10:26:24.660253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30685eea-d0a5-4abb-95bc-519ed00ae07c could not be found. Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 10:26:24.661462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:24.662645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30685eea-d0a5-4abb-95bc-519ed00ae07c could not be found. Aug 04 10:26:24.662645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.662645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.662645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.662645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.662645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:24.662645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:24.662645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:24.662645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:24.662645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30685eea-d0a5-4abb-95bc-519ed00ae07c could not be found. Aug 04 10:26:24.662645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.662645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4ed0020d-5c43-48bd-8fd0-1cc4c525736b tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Returning 404 to user: Volume 30685eea-d0a5-4abb-95bc-519ed00ae07c could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:24.662645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4ed0020d-5c43-48bd-8fd0-1cc4c525736b tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/30685eea-d0a5-4abb-95bc-519ed00ae07c" status: 404 len: 109 microversion: 2.1 time: 0.037830 Aug 04 10:26:24.662645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 82/182] 10.222.0.72 () {58 vars in 1248 bytes} [Thu Aug 4 10:26:24 2022] DELETE /compute/v2.1/os-volumes/30685eea-d0a5-4abb-95bc-519ed00ae07c => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:26:24.673178 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-12440304-9bd2-4341-aa34-1c00e4b38157 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Calling method '.version_select at 0x7fbaa5111ca0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:24.700669 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-12440304-9bd2-4341-aa34-1c00e4b38157 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] HTTP exception thrown: Volume 765742d0-e2c8-43ce-ac78-273cfd974c27 could not be found. Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-12440304-9bd2-4341-aa34-1c00e4b38157 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Request method failure captured: Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/os-volumes/765742d0-e2c8-43ce-ac78-273cfd974c27 HTTP/1.1 Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi657QporIjSGAYbODYozlWHE6YrUAo3ttF3Rtf_kvk8MoF-fvKJeJc3hEJbC0DZ2RMItG2Kt_lJMltC68u9_MAlTWy8L_PhVj7HAWIGnIk2BP7QDlFw0H9NSFqBDiiOjhkVmm_WKDMnpL9mcPGDMSYdSUoOEwD31S_6ibLs7NZ7gcD7U Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 3eb365800c0d4213b45804c34ebbf01f Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:26:24.703288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:26:24.704677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3eb365800c0d4213b45804c34ebbf01f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:26:24.704677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.704677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 3eb365800c0d4213b45804c34ebbf01f Aug 04 10:26:24.704677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesNegativeTest-162121852 Aug 04 10:26:24.704677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesNegativeTest-162121852-project Aug 04 10:26:24.704677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:26:24.704677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:26:24.704677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: e9dec61e00284c49bfd60edb7076c3a2 Aug 04 10:26:24.704677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesNegativeTest-162121852-project Aug 04 10:26:24.704677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: Aug 04 10:26:24.704677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Volume 765742d0-e2c8-43ce-ac78-273cfd974c27 could not be found. Aug 04 10:26:24.704677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '765742d0-e2c8-43ce-ac78-273cfd974c27'} Aug 04 10:26:24.704677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 765742d0-e2c8-43ce-ac78-273cfd974c27 could not be found. (HTTP 404) (Request-ID: req-b91cbdf8-5f1b-4dca-a920-550a28e6acea) Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.705498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:26:24.706694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 765742d0-e2c8-43ce-ac78-273cfd974c27 could not be found. Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 10:26:24.707864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:24.709211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 765742d0-e2c8-43ce-ac78-273cfd974c27 could not be found. Aug 04 10:26:24.709211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.709211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:24.709211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.709211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:24.709211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:24.709211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:24.709211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:24.709211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:24.709211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 765742d0-e2c8-43ce-ac78-273cfd974c27 could not be found. Aug 04 10:26:24.709211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:24.709211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-12440304-9bd2-4341-aa34-1c00e4b38157 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] Returning 404 to user: Volume 765742d0-e2c8-43ce-ac78-273cfd974c27 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:24.709211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-12440304-9bd2-4341-aa34-1c00e4b38157 tempest-VolumesNegativeTest-162121852 tempest-VolumesNegativeTest-162121852-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/765742d0-e2c8-43ce-ac78-273cfd974c27" status: 404 len: 109 microversion: 2.1 time: 0.035615 Aug 04 10:26:24.709211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 101/183] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:26:24 2022] GET /compute/v2.1/os-volumes/765742d0-e2c8-43ce-ac78-273cfd974c27 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:26:25.527547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4e10e3a0-8e8a-40fe-876f-f1afc14b795e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:25.528191 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4e10e3a0-8e8a-40fe-876f-f1afc14b795e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:25.535036 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4e10e3a0-8e8a-40fe-876f-f1afc14b795e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:25.535705 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4e10e3a0-8e8a-40fe-876f-f1afc14b795e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:25.536641 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4e10e3a0-8e8a-40fe-876f-f1afc14b795e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:25.536877 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3285f944-d372-4696-959f-56b4cc899ec6 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:25.537309 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4e10e3a0-8e8a-40fe-876f-f1afc14b795e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:25.537578 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3285f944-d372-4696-959f-56b4cc899ec6 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:25.544779 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3285f944-d372-4696-959f-56b4cc899ec6 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:25.545253 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3285f944-d372-4696-959f-56b4cc899ec6 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:25.545992 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3285f944-d372-4696-959f-56b4cc899ec6 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:25.546453 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3285f944-d372-4696-959f-56b4cc899ec6 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:25.767113 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3285f944-d372-4696-959f-56b4cc899ec6 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:25.771694 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4e10e3a0-8e8a-40fe-876f-f1afc14b795e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:25.781341 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4e10e3a0-8e8a-40fe-876f-f1afc14b795e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.255800 Aug 04 10:26:25.781671 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3285f944-d372-4696-959f-56b4cc899ec6 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1498 microversion: 2.1 time: 0.246359 Aug 04 10:26:25.783770 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 102/184] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:25 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1498 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:25.789186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 83/185] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:25 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:26.321444 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b91d1e36-c4e1-4362-b996-72d6cc017542 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:26.322206 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b91d1e36-c4e1-4362-b996-72d6cc017542 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:26.329318 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b91d1e36-c4e1-4362-b996-72d6cc017542 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:26.329805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b91d1e36-c4e1-4362-b996-72d6cc017542 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:26.330728 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b91d1e36-c4e1-4362-b996-72d6cc017542 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:26.331151 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b91d1e36-c4e1-4362-b996-72d6cc017542 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:26.363935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b91d1e36-c4e1-4362-b996-72d6cc017542 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:26:26.461119 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b91d1e36-c4e1-4362-b996-72d6cc017542 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 204 len: 0 microversion: 2.1 time: 0.143013 Aug 04 10:26:26.465106 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 103/186] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:26:26 2022] DELETE /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:26:26.470817 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b56eec1d-d981-46de-bf9e-a2e121f27b53 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:26.471462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b56eec1d-d981-46de-bf9e-a2e121f27b53 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:26.482156 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b56eec1d-d981-46de-bf9e-a2e121f27b53 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:26.482575 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b56eec1d-d981-46de-bf9e-a2e121f27b53 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:26.483351 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b56eec1d-d981-46de-bf9e-a2e121f27b53 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:26.484363 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b56eec1d-d981-46de-bf9e-a2e121f27b53 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:26.652071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b56eec1d-d981-46de-bf9e-a2e121f27b53 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:26.663344 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b56eec1d-d981-46de-bf9e-a2e121f27b53 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1504 microversion: 2.1 time: 0.197438 Aug 04 10:26:26.663922 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 84/187] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:26 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:26.801756 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c5195bba-215d-41ee-b687-b1876dc3f879 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:26.803118 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c5195bba-215d-41ee-b687-b1876dc3f879 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:26.809316 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c5195bba-215d-41ee-b687-b1876dc3f879 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:26.809767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c5195bba-215d-41ee-b687-b1876dc3f879 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:26.810588 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c5195bba-215d-41ee-b687-b1876dc3f879 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:26.811102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c5195bba-215d-41ee-b687-b1876dc3f879 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:26.828277 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:26.963788 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c5195bba-215d-41ee-b687-b1876dc3f879 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:26.973404 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c5195bba-215d-41ee-b687-b1876dc3f879 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.176133 Aug 04 10:26:26.974121 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 104/188] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:26 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:27.684403 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-699f3ca3-9635-4549-a4ee-f64db8d4043a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:27.685030 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-699f3ca3-9635-4549-a4ee-f64db8d4043a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:27.692545 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-699f3ca3-9635-4549-a4ee-f64db8d4043a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:27.693055 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-699f3ca3-9635-4549-a4ee-f64db8d4043a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:27.693865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-699f3ca3-9635-4549-a4ee-f64db8d4043a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:27.694308 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-699f3ca3-9635-4549-a4ee-f64db8d4043a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:27.828806 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-699f3ca3-9635-4549-a4ee-f64db8d4043a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:27.836987 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-699f3ca3-9635-4549-a4ee-f64db8d4043a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1504 microversion: 2.1 time: 0.156284 Aug 04 10:26:27.837654 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 85/189] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:27 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:27.996300 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e0ff941f-6dc6-47ba-90ca-cfc8bf5bbad6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:27.997045 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e0ff941f-6dc6-47ba-90ca-cfc8bf5bbad6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:28.002944 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0ff941f-6dc6-47ba-90ca-cfc8bf5bbad6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:28.003391 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0ff941f-6dc6-47ba-90ca-cfc8bf5bbad6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:28.004177 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0ff941f-6dc6-47ba-90ca-cfc8bf5bbad6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:28.004701 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0ff941f-6dc6-47ba-90ca-cfc8bf5bbad6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:28.168141 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e0ff941f-6dc6-47ba-90ca-cfc8bf5bbad6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:28.176752 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e0ff941f-6dc6-47ba-90ca-cfc8bf5bbad6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.185971 Aug 04 10:26:28.177774 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 105/190] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:27 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:28.858420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-bc238a6a-5994-4c13-9f48-ce2f176208ca tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:28.859534 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-bc238a6a-5994-4c13-9f48-ce2f176208ca tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:28.866048 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bc238a6a-5994-4c13-9f48-ce2f176208ca tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:28.866549 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bc238a6a-5994-4c13-9f48-ce2f176208ca tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:28.867285 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bc238a6a-5994-4c13-9f48-ce2f176208ca tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:28.867721 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bc238a6a-5994-4c13-9f48-ce2f176208ca tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:29.005352 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bc238a6a-5994-4c13-9f48-ce2f176208ca tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:29.013186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-bc238a6a-5994-4c13-9f48-ce2f176208ca tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1504 microversion: 2.1 time: 0.158648 Aug 04 10:26:29.013763 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 86/191] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:28 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:29.198353 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7c73166a-2e2a-4cea-8c41-563181d95c79 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:29.198959 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7c73166a-2e2a-4cea-8c41-563181d95c79 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:29.205201 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7c73166a-2e2a-4cea-8c41-563181d95c79 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:29.205647 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7c73166a-2e2a-4cea-8c41-563181d95c79 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:29.206412 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7c73166a-2e2a-4cea-8c41-563181d95c79 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:29.206844 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7c73166a-2e2a-4cea-8c41-563181d95c79 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:29.339796 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7c73166a-2e2a-4cea-8c41-563181d95c79 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:29.351099 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7c73166a-2e2a-4cea-8c41-563181d95c79 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.156576 Aug 04 10:26:29.351684 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 106/192] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:29 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:29.465271 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-3b3cd056-ec43-4736-af01-2ed71389bd99 req-b23ab621-985d-4096-929b-aaee5702a4fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2066a3db-786e-4100-8e08-51bfff15f37c", "name": "network-vif-deleted", "tag": "22fc3f38-0929-4564-a14e-3b91e2bff0ce"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:29.475441 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-3b3cd056-ec43-4736-af01-2ed71389bd99 req-b23ab621-985d-4096-929b-aaee5702a4fa service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:29.475884 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-3b3cd056-ec43-4736-af01-2ed71389bd99 req-b23ab621-985d-4096-929b-aaee5702a4fa service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:29.492689 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-3b3cd056-ec43-4736-af01-2ed71389bd99 req-b23ab621-985d-4096-929b-aaee5702a4fa service nova] Creating event network-vif-deleted:22fc3f38-0929-4564-a14e-3b91e2bff0ce for instance 2066a3db-786e-4100-8e08-51bfff15f37c on hv-cinder-82660 Aug 04 10:26:29.499590 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-3b3cd056-ec43-4736-af01-2ed71389bd99 req-b23ab621-985d-4096-929b-aaee5702a4fa service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037398 Aug 04 10:26:29.500384 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 87/193] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:30.034444 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f5cf86f7-3915-412a-b755-21bf0bf83262 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:30.035068 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f5cf86f7-3915-412a-b755-21bf0bf83262 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:30.041587 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5cf86f7-3915-412a-b755-21bf0bf83262 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:30.042375 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5cf86f7-3915-412a-b755-21bf0bf83262 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:30.043789 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5cf86f7-3915-412a-b755-21bf0bf83262 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:30.043872 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5cf86f7-3915-412a-b755-21bf0bf83262 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:30.077525 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5cf86f7-3915-412a-b755-21bf0bf83262 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:30.078492 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5cf86f7-3915-412a-b755-21bf0bf83262 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:30.078943 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-f5cf86f7-3915-412a-b755-21bf0bf83262 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lazy-loading 'fault' on Instance uuid 2066a3db-786e-4100-8e08-51bfff15f37c {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:26:30.130000 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f5cf86f7-3915-412a-b755-21bf0bf83262 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:30.137702 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f5cf86f7-3915-412a-b755-21bf0bf83262 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 200 len: 1304 microversion: 2.1 time: 0.107407 Aug 04 10:26:30.138301 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 107/194] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:30 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:30.372869 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e3f6f59f-1de3-4709-a978-537fe1ad9e4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:30.373491 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e3f6f59f-1de3-4709-a978-537fe1ad9e4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:30.380260 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e3f6f59f-1de3-4709-a978-537fe1ad9e4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:30.380703 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e3f6f59f-1de3-4709-a978-537fe1ad9e4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:30.381454 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e3f6f59f-1de3-4709-a978-537fe1ad9e4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:30.381883 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e3f6f59f-1de3-4709-a978-537fe1ad9e4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:30.516034 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e3f6f59f-1de3-4709-a978-537fe1ad9e4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:30.523711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e3f6f59f-1de3-4709-a978-537fe1ad9e4b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.155607 Aug 04 10:26:30.524302 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 88/195] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:30 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:31.159226 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ebf260ff-19a2-4d7a-b8bf-811a08bd008b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:31.159761 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ebf260ff-19a2-4d7a-b8bf-811a08bd008b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 2066a3db-786e-4100-8e08-51bfff15f37c] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:31.165617 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ebf260ff-19a2-4d7a-b8bf-811a08bd008b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:31.166180 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ebf260ff-19a2-4d7a-b8bf-811a08bd008b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:31.166943 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ebf260ff-19a2-4d7a-b8bf-811a08bd008b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:31.167378 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ebf260ff-19a2-4d7a-b8bf-811a08bd008b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:31.181603 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-ebf260ff-19a2-4d7a-b8bf-811a08bd008b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] HTTP exception thrown: Instance 2066a3db-786e-4100-8e08-51bfff15f37c could not be found. Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ebf260ff-19a2-4d7a-b8bf-811a08bd008b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Request method failure captured: Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c HTTP/1.1 Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi657Cw67wAQruwtWLPTtOdhHOVOo6PUMrDRyNerN9grW0tVX-qIpRcnjVV0tCBkpR7cMe-Tacyc0K7kbsDJGrADPErmeJH3M7G1dbtz56gQ8CY1j2SNFrxzQN6-wIl8yuaXvneTjsU74zFa4uFdcK0HHwY23Wedc_um1AAQkL1EBE-dA Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: fcc945cdc83549c3833b0e39a9496e26 Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesActionsTest-1505790814 Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:26:31.183349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:26:31.184548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/fcc945cdc83549c3833b0e39a9496e26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/fcc945cdc83549c3833b0e39a9496e26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/fcc945cdc83549c3833b0e39a9496e26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_fcc945cdc83549c3833b0e39a9496e26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:26:31.184548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesActionsTest-1505790814 Aug 04 10:26:31.184548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: fcc945cdc83549c3833b0e39a9496e26 Aug 04 10:26:31.184548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesActionsTest-1505790814 Aug 04 10:26:31.184548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesActionsTest-1505790814-project Aug 04 10:26:31.184548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:26:31.184548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:26:31.184548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: 1a7627957f0c489ebf27dcab206542ef Aug 04 10:26:31.184548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesActionsTest-1505790814-project Aug 04 10:26:31.184548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:26:31.184548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance 2066a3db-786e-4100-8e08-51bfff15f37c could not be found. Aug 04 10:26:31.184548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '2066a3db-786e-4100-8e08-51bfff15f37c'} Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2066a3db-786e-4100-8e08-51bfff15f37c could not be found. Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:31.185217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2066a3db-786e-4100-8e08-51bfff15f37c could not be found. Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2066a3db-786e-4100-8e08-51bfff15f37c could not be found. Aug 04 10:26:31.186364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:26:31.187338 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ebf260ff-19a2-4d7a-b8bf-811a08bd008b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Returning 404 to user: Instance 2066a3db-786e-4100-8e08-51bfff15f37c could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:31.187338 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ebf260ff-19a2-4d7a-b8bf-811a08bd008b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c" status: 404 len: 111 microversion: 2.1 time: 0.030161 Aug 04 10:26:31.187338 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 108/196] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:31 2022] GET /compute/v2.1/servers/2066a3db-786e-4100-8e08-51bfff15f37c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:26:31.286037 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-628102780", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "networks": [{"uuid": "9623a600-2b81-424f-99a5-00538a69574c"}]}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:31.344304 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.network.neutron [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] validate_networks() for [('9623a600-2b81-424f-99a5-00538a69574c', None, None, None, None, None)] {{(pid=117667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:26:31.545685 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c2b589e3-f3d4-46c4-951f-c665403545f3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:31.546856 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c2b589e3-f3d4-46c4-951f-c665403545f3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:31.553612 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c2b589e3-f3d4-46c4-951f-c665403545f3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:31.554148 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c2b589e3-f3d4-46c4-951f-c665403545f3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:31.555249 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c2b589e3-f3d4-46c4-951f-c665403545f3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:31.555758 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c2b589e3-f3d4-46c4-951f-c665403545f3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:31.761515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c2b589e3-f3d4-46c4-951f-c665403545f3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:31.771979 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c2b589e3-f3d4-46c4-951f-c665403545f3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.231228 Aug 04 10:26:31.772756 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 109/197] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:31 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:31.850684 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Flavor limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:26:31.851202 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Image limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:26:31.851749 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Flavor pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:26:31.852181 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Image pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:26:31.852591 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:26:31.861982 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:31.862426 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:31.863217 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:31.863654 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:31.880772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Getting quotas for project fcc945cdc83549c3833b0e39a9496e26. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:26:31.884812 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Getting quotas for user 1a7627957f0c489ebf27dcab206542ef and project fcc945cdc83549c3833b0e39a9496e26. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:26:31.896491 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Going to run 1 instances... {{(pid=117667) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:26:31.898741 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:26:31.959266 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-be59a8e1-630f-489b-aba0-94252e5313ee tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676674 Aug 04 10:26:31.968133 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 89/198] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:26:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:26:31.990349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ba5d1566-4fea-4dd2-9582-1bede46a36f9 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:31.992039 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ba5d1566-4fea-4dd2-9582-1bede46a36f9 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:32.057058 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ba5d1566-4fea-4dd2-9582-1bede46a36f9 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:32.065984 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ba5d1566-4fea-4dd2-9582-1bede46a36f9 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1213 microversion: 2.1 time: 0.093716 Aug 04 10:26:32.067258 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 110/199] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:31 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:32.795144 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0267df23-a98c-4696-98d6-d0bd5ebaaf71 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:32.796195 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0267df23-a98c-4696-98d6-d0bd5ebaaf71 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:32.804656 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0267df23-a98c-4696-98d6-d0bd5ebaaf71 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:32.805138 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0267df23-a98c-4696-98d6-d0bd5ebaaf71 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:32.806283 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0267df23-a98c-4696-98d6-d0bd5ebaaf71 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:32.806856 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0267df23-a98c-4696-98d6-d0bd5ebaaf71 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:33.029046 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0267df23-a98c-4696-98d6-d0bd5ebaaf71 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:33.036915 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0267df23-a98c-4696-98d6-d0bd5ebaaf71 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.246841 Aug 04 10:26:33.037480 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 90/200] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:32 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:33.088209 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c7121281-e713-4f54-a13c-7c51046d6480 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:33.088816 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c7121281-e713-4f54-a13c-7c51046d6480 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:33.100452 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:33.107589 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c7121281-e713-4f54-a13c-7c51046d6480 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:33.108181 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c7121281-e713-4f54-a13c-7c51046d6480 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:33.109683 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c7121281-e713-4f54-a13c-7c51046d6480 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:33.110475 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c7121281-e713-4f54-a13c-7c51046d6480 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:33.200640 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c7121281-e713-4f54-a13c-7c51046d6480 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:33.208673 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c7121281-e713-4f54-a13c-7c51046d6480 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1265 microversion: 2.1 time: 0.124235 Aug 04 10:26:33.209234 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 111/201] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:33 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:34.057957 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ce7e89bd-6b49-4573-bbf6-a1035163b989 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:34.058560 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ce7e89bd-6b49-4573-bbf6-a1035163b989 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:34.064953 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ce7e89bd-6b49-4573-bbf6-a1035163b989 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:34.065684 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ce7e89bd-6b49-4573-bbf6-a1035163b989 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:34.066401 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ce7e89bd-6b49-4573-bbf6-a1035163b989 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:34.066983 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ce7e89bd-6b49-4573-bbf6-a1035163b989 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:34.229794 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0a69e072-0410-4c6c-aea6-63c82da8350b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:34.230893 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0a69e072-0410-4c6c-aea6-63c82da8350b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:34.237874 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a69e072-0410-4c6c-aea6-63c82da8350b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:34.238636 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a69e072-0410-4c6c-aea6-63c82da8350b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:34.239629 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a69e072-0410-4c6c-aea6-63c82da8350b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:34.240929 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a69e072-0410-4c6c-aea6-63c82da8350b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:34.278409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-ce7e89bd-6b49-4573-bbf6-a1035163b989 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:34.308869 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ce7e89bd-6b49-4573-bbf6-a1035163b989 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.251727 Aug 04 10:26:34.309593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 91/202] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:34 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:34.544228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0a69e072-0410-4c6c-aea6-63c82da8350b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:34.554003 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0a69e072-0410-4c6c-aea6-63c82da8350b tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1313 microversion: 2.1 time: 0.328305 Aug 04 10:26:34.555198 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 112/203] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:34 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:35.002765 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-1e6be43c-ec21-4638-9314-f42339e40967 req-2bafecc7-5f46-4f09-ac7f-10afabbbc9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75359cd0-62ba-445d-8b26-6d765370d2ee", "tag": "76b4efd4-3be3-478a-843a-c8a8c36ee461"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:35.025202 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-1e6be43c-ec21-4638-9314-f42339e40967 req-2bafecc7-5f46-4f09-ac7f-10afabbbc9c3 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:35.026585 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-1e6be43c-ec21-4638-9314-f42339e40967 req-2bafecc7-5f46-4f09-ac7f-10afabbbc9c3 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:35.041653 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-1e6be43c-ec21-4638-9314-f42339e40967 req-2bafecc7-5f46-4f09-ac7f-10afabbbc9c3 service nova] Creating event network-changed:76b4efd4-3be3-478a-843a-c8a8c36ee461 for instance 75359cd0-62ba-445d-8b26-6d765370d2ee on hv-cinder-82660 Aug 04 10:26:35.050492 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-1e6be43c-ec21-4638-9314-f42339e40967 req-2bafecc7-5f46-4f09-ac7f-10afabbbc9c3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052089 Aug 04 10:26:35.051541 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 92/204] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:35.341015 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2a29250a-3205-463f-8a46-6d3db3cb4dd5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:35.341644 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2a29250a-3205-463f-8a46-6d3db3cb4dd5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:35.350393 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a29250a-3205-463f-8a46-6d3db3cb4dd5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:35.351079 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a29250a-3205-463f-8a46-6d3db3cb4dd5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:35.352611 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a29250a-3205-463f-8a46-6d3db3cb4dd5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:35.353204 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a29250a-3205-463f-8a46-6d3db3cb4dd5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:35.580489 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b89cf4f3-38e4-4839-8bc5-295a0e3cbe47 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:35.582135 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b89cf4f3-38e4-4839-8bc5-295a0e3cbe47 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:35.594124 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b89cf4f3-38e4-4839-8bc5-295a0e3cbe47 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:35.594809 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b89cf4f3-38e4-4839-8bc5-295a0e3cbe47 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:35.596726 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b89cf4f3-38e4-4839-8bc5-295a0e3cbe47 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:35.598376 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b89cf4f3-38e4-4839-8bc5-295a0e3cbe47 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:35.940207 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2a29250a-3205-463f-8a46-6d3db3cb4dd5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:35.950047 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2a29250a-3205-463f-8a46-6d3db3cb4dd5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.623949 Aug 04 10:26:35.952026 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 113/205] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:35 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:35.969673 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b89cf4f3-38e4-4839-8bc5-295a0e3cbe47 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:35.977449 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b89cf4f3-38e4-4839-8bc5-295a0e3cbe47 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1313 microversion: 2.1 time: 0.404433 Aug 04 10:26:35.978132 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 93/206] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:35 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:36.972855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a8e50026-90f8-47c1-9942-fb56356680cd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:36.974085 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a8e50026-90f8-47c1-9942-fb56356680cd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:36.981172 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a8e50026-90f8-47c1-9942-fb56356680cd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:36.981938 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a8e50026-90f8-47c1-9942-fb56356680cd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:36.982980 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a8e50026-90f8-47c1-9942-fb56356680cd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:36.983627 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a8e50026-90f8-47c1-9942-fb56356680cd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:36.998303 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d528e329-e38e-4a4a-89df-8fcc27ca52e4 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:37.000609 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-d528e329-e38e-4a4a-89df-8fcc27ca52e4 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:37.012959 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d528e329-e38e-4a4a-89df-8fcc27ca52e4 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:37.013419 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d528e329-e38e-4a4a-89df-8fcc27ca52e4 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:37.014209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d528e329-e38e-4a4a-89df-8fcc27ca52e4 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:37.018904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d528e329-e38e-4a4a-89df-8fcc27ca52e4 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:37.519937 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a8e50026-90f8-47c1-9942-fb56356680cd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:37.530446 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d528e329-e38e-4a4a-89df-8fcc27ca52e4 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:37.537318 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a8e50026-90f8-47c1-9942-fb56356680cd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.567772 Aug 04 10:26:37.538106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d528e329-e38e-4a4a-89df-8fcc27ca52e4 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1313 microversion: 2.1 time: 0.544095 Aug 04 10:26:37.538943 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 114/207] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:36 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:37.548396 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 94/208] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:36 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1313 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:38.560130 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-33f80ccc-1532-47fb-8df9-3f5bec362c9c tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:38.561569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-33f80ccc-1532-47fb-8df9-3f5bec362c9c tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:38.568122 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b57357b3-95f7-40b8-b339-b1e7d779ecc9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:38.570552 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b57357b3-95f7-40b8-b339-b1e7d779ecc9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:38.571048 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33f80ccc-1532-47fb-8df9-3f5bec362c9c tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:38.571685 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33f80ccc-1532-47fb-8df9-3f5bec362c9c tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:38.575338 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33f80ccc-1532-47fb-8df9-3f5bec362c9c tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:38.576193 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33f80ccc-1532-47fb-8df9-3f5bec362c9c tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:38.602056 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b57357b3-95f7-40b8-b339-b1e7d779ecc9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:38.602512 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b57357b3-95f7-40b8-b339-b1e7d779ecc9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:38.610185 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b57357b3-95f7-40b8-b339-b1e7d779ecc9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:38.613489 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b57357b3-95f7-40b8-b339-b1e7d779ecc9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:38.930881 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-33f80ccc-1532-47fb-8df9-3f5bec362c9c tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:38.946913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-33f80ccc-1532-47fb-8df9-3f5bec362c9c tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1313 microversion: 2.1 time: 0.387285 Aug 04 10:26:38.963189 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 115/209] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:38 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:38.980243 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b57357b3-95f7-40b8-b339-b1e7d779ecc9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:38.994301 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b57357b3-95f7-40b8-b339-b1e7d779ecc9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.434250 Aug 04 10:26:38.996023 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 95/210] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:38 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:39.971922 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b19eb9e6-764a-46c6-b7f9-1fb1e8b4ab20 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:39.972801 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b19eb9e6-764a-46c6-b7f9-1fb1e8b4ab20 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:40.007482 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b19eb9e6-764a-46c6-b7f9-1fb1e8b4ab20 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:40.009783 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b19eb9e6-764a-46c6-b7f9-1fb1e8b4ab20 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:40.022190 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c2c8d102-48e4-4878-84bc-f6efd4d2364f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:40.024144 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c2c8d102-48e4-4878-84bc-f6efd4d2364f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:40.032382 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b19eb9e6-764a-46c6-b7f9-1fb1e8b4ab20 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:40.038920 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b19eb9e6-764a-46c6-b7f9-1fb1e8b4ab20 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:40.050509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c2c8d102-48e4-4878-84bc-f6efd4d2364f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:40.054052 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c2c8d102-48e4-4878-84bc-f6efd4d2364f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:40.061271 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c2c8d102-48e4-4878-84bc-f6efd4d2364f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:40.084943 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c2c8d102-48e4-4878-84bc-f6efd4d2364f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:40.497979 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b19eb9e6-764a-46c6-b7f9-1fb1e8b4ab20 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:40.510442 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b19eb9e6-764a-46c6-b7f9-1fb1e8b4ab20 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1313 microversion: 2.1 time: 0.543924 Aug 04 10:26:40.513602 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 116/211] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:39 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:40.523159 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c2c8d102-48e4-4878-84bc-f6efd4d2364f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:40.534187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c2c8d102-48e4-4878-84bc-f6efd4d2364f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.519316 Aug 04 10:26:40.538427 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 96/212] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:40 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:41.533090 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5e5e19da-4a9b-4019-87e2-6479257ea79a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:41.534365 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5e5e19da-4a9b-4019-87e2-6479257ea79a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:41.545785 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5e5e19da-4a9b-4019-87e2-6479257ea79a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:41.546506 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5e5e19da-4a9b-4019-87e2-6479257ea79a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:41.549932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5e5e19da-4a9b-4019-87e2-6479257ea79a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:41.550658 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5e5e19da-4a9b-4019-87e2-6479257ea79a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:41.559146 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-531fa285-c2ba-41e7-8a08-4ceb78973bb3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:41.560533 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-531fa285-c2ba-41e7-8a08-4ceb78973bb3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:41.576712 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-531fa285-c2ba-41e7-8a08-4ceb78973bb3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:41.578161 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-531fa285-c2ba-41e7-8a08-4ceb78973bb3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:41.579393 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-531fa285-c2ba-41e7-8a08-4ceb78973bb3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:41.579999 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-531fa285-c2ba-41e7-8a08-4ceb78973bb3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:41.871005 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:41.891869 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=6 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:41.946191 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-531fa285-c2ba-41e7-8a08-4ceb78973bb3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:41.955159 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5e5e19da-4a9b-4019-87e2-6479257ea79a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:41.965328 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5e5e19da-4a9b-4019-87e2-6479257ea79a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1313 microversion: 2.1 time: 0.436308 Aug 04 10:26:41.966339 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 117/213] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:41 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:41.970270 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-531fa285-c2ba-41e7-8a08-4ceb78973bb3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1522 microversion: 2.1 time: 0.414776 Aug 04 10:26:41.971041 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 97/214] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:41 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:41.985513 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-4ba704fd-4a5c-4749-a7fc-88e453153f48 req-2bf1d62b-3f28-40ca-99c3-2331ec793ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75359cd0-62ba-445d-8b26-6d765370d2ee", "name": "network-vif-plugged", "status": "completed", "tag": "76b4efd4-3be3-478a-843a-c8a8c36ee461"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:41.995433 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-4ba704fd-4a5c-4749-a7fc-88e453153f48 req-2bf1d62b-3f28-40ca-99c3-2331ec793ddf service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:41.995877 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-4ba704fd-4a5c-4749-a7fc-88e453153f48 req-2bf1d62b-3f28-40ca-99c3-2331ec793ddf service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:42.012587 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-4ba704fd-4a5c-4749-a7fc-88e453153f48 req-2bf1d62b-3f28-40ca-99c3-2331ec793ddf service nova] Creating event network-vif-plugged:76b4efd4-3be3-478a-843a-c8a8c36ee461 for instance 75359cd0-62ba-445d-8b26-6d765370d2ee on hv-cinder-82660 Aug 04 10:26:42.017748 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-4ba704fd-4a5c-4749-a7fc-88e453153f48 req-2bf1d62b-3f28-40ca-99c3-2331ec793ddf service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048372 Aug 04 10:26:42.018831 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 118/215] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:42.558392 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1135845649", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "networks": [{"uuid": "9886ce49-3a2d-4555-bb90-5ae2a85f5577"}]}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:42.571284 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:42.648778 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.network.neutron [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] validate_networks() for [('9886ce49-3a2d-4555-bb90-5ae2a85f5577', None, None, None, None, None)] {{(pid=117667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:26:42.989706 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d5e8d5d4-567c-4fa9-a809-34c99116a277 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:42.990639 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d5e8d5d4-567c-4fa9-a809-34c99116a277 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:42.997250 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:43.007522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5e8d5d4-567c-4fa9-a809-34c99116a277 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:43.017469 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5e8d5d4-567c-4fa9-a809-34c99116a277 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:43.022258 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5e8d5d4-567c-4fa9-a809-34c99116a277 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:43.023102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5e8d5d4-567c-4fa9-a809-34c99116a277 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:43.454526 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Flavor limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:26:43.455292 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d5e8d5d4-567c-4fa9-a809-34c99116a277 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:43.456232 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Image limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:26:43.460309 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Flavor pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:26:43.460955 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Image pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:26:43.461840 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:26:43.475827 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d5e8d5d4-567c-4fa9-a809-34c99116a277 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1313 microversion: 2.1 time: 0.486775 Aug 04 10:26:43.477140 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 119/216] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:42 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:43.483044 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:43.483919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:43.486501 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:43.487203 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:43.487686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-859c67dd-b349-4491-9054-da47b9bb6dd7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:43.490640 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-859c67dd-b349-4491-9054-da47b9bb6dd7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:43.512523 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-859c67dd-b349-4491-9054-da47b9bb6dd7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:43.513600 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-859c67dd-b349-4491-9054-da47b9bb6dd7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:43.516868 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-859c67dd-b349-4491-9054-da47b9bb6dd7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:43.517533 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-859c67dd-b349-4491-9054-da47b9bb6dd7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:43.535272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Getting quotas for project 25fefc765ecb42728a941ddad185e082. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:26:43.547197 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Getting quotas for user f20047857e8c4e36a031813729c09a2b and project 25fefc765ecb42728a941ddad185e082. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:26:43.576911 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Going to run 1 instances... {{(pid=117667) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:26:43.589809 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:26:43.726635 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9e76e078-0102-4938-99c6-267171c0ca68 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166434 Aug 04 10:26:43.739327 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 98/217] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:26:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:26:43.745251 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-07b9b15d-fc5f-4770-a762-411d871e22c5 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:43.745868 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-07b9b15d-fc5f-4770-a762-411d871e22c5 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:44.106372 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-07b9b15d-fc5f-4770-a762-411d871e22c5 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:44.117734 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-07b9b15d-fc5f-4770-a762-411d871e22c5 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1219 microversion: 2.1 time: 0.376219 Aug 04 10:26:44.120861 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 99/218] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:43 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1219 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:44.503840 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-66d94421-a382-494f-92a3-841679570c80 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:44.504813 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-66d94421-a382-494f-92a3-841679570c80 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:44.521432 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-66d94421-a382-494f-92a3-841679570c80 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:44.524239 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-66d94421-a382-494f-92a3-841679570c80 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:44.525151 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-66d94421-a382-494f-92a3-841679570c80 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:44.527612 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-66d94421-a382-494f-92a3-841679570c80 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:44.528752 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-859c67dd-b349-4491-9054-da47b9bb6dd7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:44.540808 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-859c67dd-b349-4491-9054-da47b9bb6dd7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1502 microversion: 2.1 time: 1.061300 Aug 04 10:26:44.544317 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 120/219] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:43 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1502 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:44.561073 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e10a73c1-ebab-4830-a3fb-01f87eb80e92 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:44.562889 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e10a73c1-ebab-4830-a3fb-01f87eb80e92 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:44.572692 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e10a73c1-ebab-4830-a3fb-01f87eb80e92 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:44.574097 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e10a73c1-ebab-4830-a3fb-01f87eb80e92 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:44.576779 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e10a73c1-ebab-4830-a3fb-01f87eb80e92 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:44.578206 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e10a73c1-ebab-4830-a3fb-01f87eb80e92 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:44.871070 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-66d94421-a382-494f-92a3-841679570c80 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:44.881058 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-66d94421-a382-494f-92a3-841679570c80 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1498 microversion: 2.1 time: 0.388173 Aug 04 10:26:44.881951 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 100/220] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:44 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1498 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:44.907646 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e10a73c1-ebab-4830-a3fb-01f87eb80e92 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:44.923670 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e10a73c1-ebab-4830-a3fb-01f87eb80e92 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1514 microversion: 2.1 time: 0.363262 Aug 04 10:26:44.925912 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 121/221] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:44 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1514 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:45.145614 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-011b98b1-7318-46a0-babf-9d6f8a427a70 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:45.146236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-011b98b1-7318-46a0-babf-9d6f8a427a70 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:45.158683 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-011b98b1-7318-46a0-babf-9d6f8a427a70 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:45.159135 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-011b98b1-7318-46a0-babf-9d6f8a427a70 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:45.159974 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-011b98b1-7318-46a0-babf-9d6f8a427a70 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:45.160417 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-011b98b1-7318-46a0-babf-9d6f8a427a70 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:45.442219 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-011b98b1-7318-46a0-babf-9d6f8a427a70 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:45.447905 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=100 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:45.454883 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-011b98b1-7318-46a0-babf-9d6f8a427a70 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1271 microversion: 2.1 time: 0.315950 Aug 04 10:26:45.467502 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 101/222] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:45 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1271 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:45.906256 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-85299df3-da6c-4496-9028-0168b4e6829a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:45.907351 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-85299df3-da6c-4496-9028-0168b4e6829a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:45.926189 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-85299df3-da6c-4496-9028-0168b4e6829a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:45.928133 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-85299df3-da6c-4496-9028-0168b4e6829a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:45.933072 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-85299df3-da6c-4496-9028-0168b4e6829a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:45.938882 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-85299df3-da6c-4496-9028-0168b4e6829a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:46.022800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-85299df3-da6c-4496-9028-0168b4e6829a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:26:46.088399 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:46.314940 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-85299df3-da6c-4496-9028-0168b4e6829a tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "DELETE /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 204 len: 0 microversion: 2.1 time: 0.418034 Aug 04 10:26:46.319407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 122/223] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:26:45 2022] DELETE /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:26:46.328236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0e45b22a-23b6-4d6f-9a13-112a963a9fb8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:46.328850 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0e45b22a-23b6-4d6f-9a13-112a963a9fb8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:46.355654 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0e45b22a-23b6-4d6f-9a13-112a963a9fb8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:46.356147 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0e45b22a-23b6-4d6f-9a13-112a963a9fb8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:46.356941 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0e45b22a-23b6-4d6f-9a13-112a963a9fb8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:46.357384 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0e45b22a-23b6-4d6f-9a13-112a963a9fb8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:46.484577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bb13d1fb-88fb-44c0-8d7d-9f393b81e79f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:46.490997 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bb13d1fb-88fb-44c0-8d7d-9f393b81e79f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:46.518908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bb13d1fb-88fb-44c0-8d7d-9f393b81e79f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:46.520299 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bb13d1fb-88fb-44c0-8d7d-9f393b81e79f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:46.522137 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bb13d1fb-88fb-44c0-8d7d-9f393b81e79f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:46.524571 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bb13d1fb-88fb-44c0-8d7d-9f393b81e79f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:46.734549 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bb13d1fb-88fb-44c0-8d7d-9f393b81e79f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:46.760773 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bb13d1fb-88fb-44c0-8d7d-9f393b81e79f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1277 microversion: 2.1 time: 0.284174 Aug 04 10:26:46.780502 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 123/224] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:46 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1277 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:46.816222 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5bff3b9e-d673-4bbc-aa9f-7208874db4b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:46.818730 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5bff3b9e-d673-4bbc-aa9f-7208874db4b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:46.823023 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0e45b22a-23b6-4d6f-9a13-112a963a9fb8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:46.833544 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5bff3b9e-d673-4bbc-aa9f-7208874db4b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:46.834031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5bff3b9e-d673-4bbc-aa9f-7208874db4b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:46.834907 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5bff3b9e-d673-4bbc-aa9f-7208874db4b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:46.835439 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5bff3b9e-d673-4bbc-aa9f-7208874db4b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:46.853844 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0e45b22a-23b6-4d6f-9a13-112a963a9fb8 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1504 microversion: 2.1 time: 0.528581 Aug 04 10:26:46.865215 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 102/225] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:46 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1504 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:46.880019 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-5bff3b9e-d673-4bbc-aa9f-7208874db4b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lazy-loading 'flavor' on Instance uuid ef5108fd-663e-4c6a-bab7-2c706a4b0ebe {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:26:46.980470 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5bff3b9e-d673-4bbc-aa9f-7208874db4b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "POST /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe/action" status: 200 len: 32 microversion: 2.1 time: 0.167279 Aug 04 10:26:46.984322 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 124/226] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:26:46 2022] POST /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 10:26:46.993708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b2c6612f-4f7e-48c8-b5ac-71d4cb6b35e6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:46.994877 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b2c6612f-4f7e-48c8-b5ac-71d4cb6b35e6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:47.003526 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b2c6612f-4f7e-48c8-b5ac-71d4cb6b35e6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:47.004410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b2c6612f-4f7e-48c8-b5ac-71d4cb6b35e6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:47.006256 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b2c6612f-4f7e-48c8-b5ac-71d4cb6b35e6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:47.007013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b2c6612f-4f7e-48c8-b5ac-71d4cb6b35e6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:47.290294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b2c6612f-4f7e-48c8-b5ac-71d4cb6b35e6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:47.299407 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b2c6612f-4f7e-48c8-b5ac-71d4cb6b35e6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.312022 Aug 04 10:26:47.300038 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 103/227] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:46 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:47.817005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ddd73376-4d7f-45da-9402-0c4900b74924 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:47.817946 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ddd73376-4d7f-45da-9402-0c4900b74924 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:47.826769 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ddd73376-4d7f-45da-9402-0c4900b74924 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:47.827521 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ddd73376-4d7f-45da-9402-0c4900b74924 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:47.828545 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ddd73376-4d7f-45da-9402-0c4900b74924 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:47.829156 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ddd73376-4d7f-45da-9402-0c4900b74924 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:47.878306 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dcf3b1b1-0fd0-493f-b327-c9b3757241ea tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:47.879600 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dcf3b1b1-0fd0-493f-b327-c9b3757241ea tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:47.895325 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dcf3b1b1-0fd0-493f-b327-c9b3757241ea tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:47.896851 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dcf3b1b1-0fd0-493f-b327-c9b3757241ea tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:47.897876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dcf3b1b1-0fd0-493f-b327-c9b3757241ea tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:47.899037 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dcf3b1b1-0fd0-493f-b327-c9b3757241ea tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:48.431545 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ddd73376-4d7f-45da-9402-0c4900b74924 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:48.432341 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-dcf3b1b1-0fd0-493f-b327-c9b3757241ea tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:48.450698 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ddd73376-4d7f-45da-9402-0c4900b74924 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1319 microversion: 2.1 time: 0.639082 Aug 04 10:26:48.453357 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-dcf3b1b1-0fd0-493f-b327-c9b3757241ea tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1504 microversion: 2.1 time: 0.579535 Aug 04 10:26:48.466260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 125/228] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:47 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1319 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:48.486491 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2a76659c-13dd-4553-b7c0-af66f05cea6b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:48.487260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2a76659c-13dd-4553-b7c0-af66f05cea6b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:48.488423 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 104/229] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:47 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1504 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:48.499809 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a76659c-13dd-4553-b7c0-af66f05cea6b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:48.500590 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a76659c-13dd-4553-b7c0-af66f05cea6b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:48.501570 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a76659c-13dd-4553-b7c0-af66f05cea6b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:48.502089 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a76659c-13dd-4553-b7c0-af66f05cea6b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:48.613070 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-7894cd61-b46a-4245-bb77-148928eddc98 req-71bcd2b0-b7a7-4386-a40d-b296999309c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c66993-74b2-46a9-a9d1-c954c3d7fd2b", "tag": "c32f70f1-3ac3-48e7-a8b4-6d1ba2e8d2d2"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:48.632125 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-7894cd61-b46a-4245-bb77-148928eddc98 req-71bcd2b0-b7a7-4386-a40d-b296999309c2 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:48.634665 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-7894cd61-b46a-4245-bb77-148928eddc98 req-71bcd2b0-b7a7-4386-a40d-b296999309c2 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:48.674688 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-7894cd61-b46a-4245-bb77-148928eddc98 req-71bcd2b0-b7a7-4386-a40d-b296999309c2 service nova] Creating event network-changed:c32f70f1-3ac3-48e7-a8b4-6d1ba2e8d2d2 for instance 67c66993-74b2-46a9-a9d1-c954c3d7fd2b on hv-cinder-82660 Aug 04 10:26:48.686860 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-7894cd61-b46a-4245-bb77-148928eddc98 req-71bcd2b0-b7a7-4386-a40d-b296999309c2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077614 Aug 04 10:26:48.690331 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 105/230] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:26:48.742693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2a76659c-13dd-4553-b7c0-af66f05cea6b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:48.765474 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2a76659c-13dd-4553-b7c0-af66f05cea6b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.297942 Aug 04 10:26:48.786126 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 126/231] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:48 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:49.474139 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9f17b583-f27d-47db-ac91-ea5498b17f13 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:49.474791 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9f17b583-f27d-47db-ac91-ea5498b17f13 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:49.480721 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9f17b583-f27d-47db-ac91-ea5498b17f13 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:49.481234 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9f17b583-f27d-47db-ac91-ea5498b17f13 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:49.482005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9f17b583-f27d-47db-ac91-ea5498b17f13 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:49.482433 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9f17b583-f27d-47db-ac91-ea5498b17f13 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:49.493986 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-024df9c5-8be0-4284-ab54-f39d4c891777 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Action: 'create', calling method: .version_select at 0x7fbaa4915ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1352145375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN43AQXsB1FgwQHOth9ZsN6ki4PMh5L+Z1ZliXzAKgtXtAJBUREB0pA2vUND/Zm2H0FlpDe3WNTu8qFjkfChrwy1IxhKRk99aVg1zart9DhFJ9GS4kr1WUwORVJSg0EjUQ=="}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:49.509279 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-024df9c5-8be0-4284-ab54-f39d4c891777 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Getting quotas for project 5084c2b61ad2427d91e0fc85392aee14. Resources: {'key_pairs'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:26:49.513370 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-024df9c5-8be0-4284-ab54-f39d4c891777 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Getting quotas for user c1ecb46bae9e4e369416d138203abe6f and project 5084c2b61ad2427d91e0fc85392aee14. Resources: {'key_pairs'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:26:49.537758 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-024df9c5-8be0-4284-ab54-f39d4c891777 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.210795 Aug 04 10:26:49.543187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 106/232] 10.222.0.72 () {60 vars in 1159 bytes} [Thu Aug 4 10:26:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:49.543680 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7a820836-86d3-483d-99b7-104dd537d4b7 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:49.545150 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7a820836-86d3-483d-99b7-104dd537d4b7 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:49.553101 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7a820836-86d3-483d-99b7-104dd537d4b7 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:49.553550 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7a820836-86d3-483d-99b7-104dd537d4b7 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:49.554316 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7a820836-86d3-483d-99b7-104dd537d4b7 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:49.554751 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7a820836-86d3-483d-99b7-104dd537d4b7 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:49.676428 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9f17b583-f27d-47db-ac91-ea5498b17f13 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:49.687946 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9f17b583-f27d-47db-ac91-ea5498b17f13 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1319 microversion: 2.1 time: 0.217403 Aug 04 10:26:49.689346 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 127/233] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:49 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:49.739076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-7a820836-86d3-483d-99b7-104dd537d4b7 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:49.747203 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7a820836-86d3-483d-99b7-104dd537d4b7 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1504 microversion: 2.1 time: 0.207440 Aug 04 10:26:49.748079 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 107/234] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:49 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:49.794244 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3a0afc20-5a35-4109-8015-497e2af332e3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:49.794885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3a0afc20-5a35-4109-8015-497e2af332e3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:49.803339 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3a0afc20-5a35-4109-8015-497e2af332e3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:49.804272 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3a0afc20-5a35-4109-8015-497e2af332e3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:49.805131 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3a0afc20-5a35-4109-8015-497e2af332e3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:49.805830 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3a0afc20-5a35-4109-8015-497e2af332e3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:49.955277 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3a0afc20-5a35-4109-8015-497e2af332e3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:49.963527 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3a0afc20-5a35-4109-8015-497e2af332e3 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.173743 Aug 04 10:26:49.964188 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 128/235] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:49 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:50.710848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5a16aab3-b568-4a71-991f-ebb374da9129 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:50.711436 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5a16aab3-b568-4a71-991f-ebb374da9129 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:50.719219 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a16aab3-b568-4a71-991f-ebb374da9129 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:50.719869 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a16aab3-b568-4a71-991f-ebb374da9129 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:50.721616 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a16aab3-b568-4a71-991f-ebb374da9129 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:50.722354 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a16aab3-b568-4a71-991f-ebb374da9129 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:50.769528 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f3831c46-c29b-4e67-b8e5-7095c039a58e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:50.782416 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f3831c46-c29b-4e67-b8e5-7095c039a58e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:50.804839 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f3831c46-c29b-4e67-b8e5-7095c039a58e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:50.805442 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f3831c46-c29b-4e67-b8e5-7095c039a58e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:50.808132 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f3831c46-c29b-4e67-b8e5-7095c039a58e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:50.809678 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f3831c46-c29b-4e67-b8e5-7095c039a58e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:51.155439 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5a16aab3-b568-4a71-991f-ebb374da9129 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:51.156643 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f3831c46-c29b-4e67-b8e5-7095c039a58e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:51.174318 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f3831c46-c29b-4e67-b8e5-7095c039a58e tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1504 microversion: 2.1 time: 0.409951 Aug 04 10:26:51.193633 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 129/236] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:50 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1504 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:51.193963 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5a16aab3-b568-4a71-991f-ebb374da9129 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1319 microversion: 2.1 time: 0.472943 Aug 04 10:26:51.193963 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 108/237] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:50 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1319 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:51.194165 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9c8651e4-57ce-4073-91cc-c0c21ca83fb4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:51.194165 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9c8651e4-57ce-4073-91cc-c0c21ca83fb4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:51.209811 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9c8651e4-57ce-4073-91cc-c0c21ca83fb4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:51.211428 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9c8651e4-57ce-4073-91cc-c0c21ca83fb4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:51.212635 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9c8651e4-57ce-4073-91cc-c0c21ca83fb4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:51.214736 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9c8651e4-57ce-4073-91cc-c0c21ca83fb4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:51.617693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9c8651e4-57ce-4073-91cc-c0c21ca83fb4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:51.626274 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9c8651e4-57ce-4073-91cc-c0c21ca83fb4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.443486 Aug 04 10:26:51.641054 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 130/238] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:51 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:51.978148 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-4ed4adf1-a384-4984-8e84-55fbd5cde805 req-204a3513-1e55-474e-8eda-b3632c200c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75359cd0-62ba-445d-8b26-6d765370d2ee", "name": "network-vif-deleted", "tag": "76b4efd4-3be3-478a-843a-c8a8c36ee461"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:51.990015 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-4ed4adf1-a384-4984-8e84-55fbd5cde805 req-204a3513-1e55-474e-8eda-b3632c200c4d service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:51.990545 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-4ed4adf1-a384-4984-8e84-55fbd5cde805 req-204a3513-1e55-474e-8eda-b3632c200c4d service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:52.004213 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-4ed4adf1-a384-4984-8e84-55fbd5cde805 req-204a3513-1e55-474e-8eda-b3632c200c4d service nova] Creating event network-vif-deleted:76b4efd4-3be3-478a-843a-c8a8c36ee461 for instance 75359cd0-62ba-445d-8b26-6d765370d2ee on hv-cinder-82660 Aug 04 10:26:52.011307 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-4ed4adf1-a384-4984-8e84-55fbd5cde805 req-204a3513-1e55-474e-8eda-b3632c200c4d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037036 Aug 04 10:26:52.012484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 109/239] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:52.201721 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4f43a14e-962e-4466-aae9-66ba626ca945 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:52.202519 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4f43a14e-962e-4466-aae9-66ba626ca945 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:52.207384 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-204d6ed0-7d19-46ed-a3fd-17edbe9c7431 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:52.208137 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-204d6ed0-7d19-46ed-a3fd-17edbe9c7431 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:52.210441 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4f43a14e-962e-4466-aae9-66ba626ca945 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:52.211243 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4f43a14e-962e-4466-aae9-66ba626ca945 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:52.212309 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4f43a14e-962e-4466-aae9-66ba626ca945 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:52.213077 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4f43a14e-962e-4466-aae9-66ba626ca945 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:52.215456 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-204d6ed0-7d19-46ed-a3fd-17edbe9c7431 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:52.215917 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-204d6ed0-7d19-46ed-a3fd-17edbe9c7431 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:52.216718 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-204d6ed0-7d19-46ed-a3fd-17edbe9c7431 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:52.217155 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-204d6ed0-7d19-46ed-a3fd-17edbe9c7431 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:52.257314 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4f43a14e-962e-4466-aae9-66ba626ca945 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:52.258442 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4f43a14e-962e-4466-aae9-66ba626ca945 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:52.259455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-4f43a14e-962e-4466-aae9-66ba626ca945 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lazy-loading 'fault' on Instance uuid 75359cd0-62ba-445d-8b26-6d765370d2ee {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:26:52.337305 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4f43a14e-962e-4466-aae9-66ba626ca945 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7627957f0c489ebf27dcab206542ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc945cdc83549c3833b0e39a9496e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:52.349066 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4f43a14e-962e-4466-aae9-66ba626ca945 tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 200 len: 1303 microversion: 2.1 time: 0.151607 Aug 04 10:26:52.349785 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 131/240] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:52 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:52.413620 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-204d6ed0-7d19-46ed-a3fd-17edbe9c7431 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:52.421285 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-204d6ed0-7d19-46ed-a3fd-17edbe9c7431 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1319 microversion: 2.1 time: 0.218354 Aug 04 10:26:52.421904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 110/241] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:52 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:52.650898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-eed33f0e-ba02-47ed-b567-17c0aadbe20e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:52.651929 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-eed33f0e-ba02-47ed-b567-17c0aadbe20e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:52.661313 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eed33f0e-ba02-47ed-b567-17c0aadbe20e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:52.661993 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eed33f0e-ba02-47ed-b567-17c0aadbe20e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:52.663085 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eed33f0e-ba02-47ed-b567-17c0aadbe20e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:52.663846 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eed33f0e-ba02-47ed-b567-17c0aadbe20e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:52.822259 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-eed33f0e-ba02-47ed-b567-17c0aadbe20e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:52.831775 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-eed33f0e-ba02-47ed-b567-17c0aadbe20e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.184958 Aug 04 10:26:52.832408 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 132/242] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:52 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:53.382635 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-11b6d6a4-a772-4936-a2d7-c4b627b465ba tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:53.383254 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-11b6d6a4-a772-4936-a2d7-c4b627b465ba tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] [instance: 75359cd0-62ba-445d-8b26-6d765370d2ee] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:53.389993 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-11b6d6a4-a772-4936-a2d7-c4b627b465ba tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:53.390436 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-11b6d6a4-a772-4936-a2d7-c4b627b465ba tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:53.391184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-11b6d6a4-a772-4936-a2d7-c4b627b465ba tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:53.391614 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-11b6d6a4-a772-4936-a2d7-c4b627b465ba tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:53.405966 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-11b6d6a4-a772-4936-a2d7-c4b627b465ba tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] HTTP exception thrown: Instance 75359cd0-62ba-445d-8b26-6d765370d2ee could not be found. Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-11b6d6a4-a772-4936-a2d7-c4b627b465ba tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Request method failure captured: Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee HTTP/1.1 Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi657Cw67wAQruwtWLPTtOdhHOVOo6PUMrDRyNerN9grW0tVX-qIpRcnjVV0tCBkpR7cMe-Tacyc0K7kbsDJGrADPErmeJH3M7G1dbtz56gQ8CY1j2SNFrxzQN6-wIl8yuaXvneTjsU74zFa4uFdcK0HHwY23Wedc_um1AAQkL1EBE-dA Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: fcc945cdc83549c3833b0e39a9496e26 Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-VolumesActionsTest-1505790814 Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:26:53.407569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:26:53.409126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/fcc945cdc83549c3833b0e39a9496e26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/fcc945cdc83549c3833b0e39a9496e26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/fcc945cdc83549c3833b0e39a9496e26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_fcc945cdc83549c3833b0e39a9496e26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:26:53.409126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-VolumesActionsTest-1505790814 Aug 04 10:26:53.409126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: fcc945cdc83549c3833b0e39a9496e26 Aug 04 10:26:53.409126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-VolumesActionsTest-1505790814 Aug 04 10:26:53.409126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-VolumesActionsTest-1505790814-project Aug 04 10:26:53.409126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:26:53.409126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:26:53.409126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: 1a7627957f0c489ebf27dcab206542ef Aug 04 10:26:53.409126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-VolumesActionsTest-1505790814-project Aug 04 10:26:53.409126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:26:53.409126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 75359cd0-62ba-445d-8b26-6d765370d2ee could not be found. Aug 04 10:26:53.409126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '75359cd0-62ba-445d-8b26-6d765370d2ee'} Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75359cd0-62ba-445d-8b26-6d765370d2ee could not be found. Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:53.410049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75359cd0-62ba-445d-8b26-6d765370d2ee could not be found. Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75359cd0-62ba-445d-8b26-6d765370d2ee could not be found. Aug 04 10:26:53.411447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:26:53.412820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-11b6d6a4-a772-4936-a2d7-c4b627b465ba tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] Returning 404 to user: Instance 75359cd0-62ba-445d-8b26-6d765370d2ee could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:53.412820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-11b6d6a4-a772-4936-a2d7-c4b627b465ba tempest-VolumesActionsTest-1505790814 tempest-VolumesActionsTest-1505790814-project] 10.222.0.72 "GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee" status: 404 len: 111 microversion: 2.1 time: 0.030198 Aug 04 10:26:53.412820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 111/243] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:53 2022] GET /compute/v2.1/servers/75359cd0-62ba-445d-8b26-6d765370d2ee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:26:53.443886 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-19a987bb-d225-4fc9-b2b3-41d577cfe869 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:53.444581 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-19a987bb-d225-4fc9-b2b3-41d577cfe869 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:53.455594 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19a987bb-d225-4fc9-b2b3-41d577cfe869 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:53.455594 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19a987bb-d225-4fc9-b2b3-41d577cfe869 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:53.455594 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19a987bb-d225-4fc9-b2b3-41d577cfe869 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:53.455594 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19a987bb-d225-4fc9-b2b3-41d577cfe869 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:53.632823 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-19a987bb-d225-4fc9-b2b3-41d577cfe869 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:53.641925 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-19a987bb-d225-4fc9-b2b3-41d577cfe869 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1319 microversion: 2.1 time: 0.202181 Aug 04 10:26:53.642503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 133/244] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:53 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:53.853031 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-34635fe4-cdae-4bc1-8fd1-4189c3ea7662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:53.854065 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-34635fe4-cdae-4bc1-8fd1-4189c3ea7662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:53.856429 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:53.862432 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-34635fe4-cdae-4bc1-8fd1-4189c3ea7662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:53.862882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-34635fe4-cdae-4bc1-8fd1-4189c3ea7662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:53.863656 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-34635fe4-cdae-4bc1-8fd1-4189c3ea7662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:53.864171 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-34635fe4-cdae-4bc1-8fd1-4189c3ea7662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:54.010003 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-34635fe4-cdae-4bc1-8fd1-4189c3ea7662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:54.017605 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-34635fe4-cdae-4bc1-8fd1-4189c3ea7662 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.168561 Aug 04 10:26:54.018165 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 112/245] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:53 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:54.662182 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-12a70479-cea5-411b-a28a-ed788be5f4c0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:54.662932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-12a70479-cea5-411b-a28a-ed788be5f4c0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:54.670994 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-12a70479-cea5-411b-a28a-ed788be5f4c0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:54.671438 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-12a70479-cea5-411b-a28a-ed788be5f4c0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:54.672230 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-12a70479-cea5-411b-a28a-ed788be5f4c0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:54.672658 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-12a70479-cea5-411b-a28a-ed788be5f4c0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:54.814345 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-12a70479-cea5-411b-a28a-ed788be5f4c0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:54.822081 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-12a70479-cea5-411b-a28a-ed788be5f4c0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1319 microversion: 2.1 time: 0.163833 Aug 04 10:26:54.822661 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 134/246] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:54 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:55.039004 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-fbedcc52-965b-4ce8-8d31-4fd73fe84ece tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:55.039765 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-fbedcc52-965b-4ce8-8d31-4fd73fe84ece tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:55.047378 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fbedcc52-965b-4ce8-8d31-4fd73fe84ece tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:55.048108 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fbedcc52-965b-4ce8-8d31-4fd73fe84ece tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:55.048899 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fbedcc52-965b-4ce8-8d31-4fd73fe84ece tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:55.049339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fbedcc52-965b-4ce8-8d31-4fd73fe84ece tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:55.195944 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-fbedcc52-965b-4ce8-8d31-4fd73fe84ece tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:55.203776 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-fbedcc52-965b-4ce8-8d31-4fd73fe84ece tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.168583 Aug 04 10:26:55.204542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 113/247] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:55 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:55.843524 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b09fb1e5-412c-4af8-a6cb-aace028a7621 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:55.844828 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b09fb1e5-412c-4af8-a6cb-aace028a7621 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:55.851167 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b09fb1e5-412c-4af8-a6cb-aace028a7621 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:55.851881 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b09fb1e5-412c-4af8-a6cb-aace028a7621 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:55.852748 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b09fb1e5-412c-4af8-a6cb-aace028a7621 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:55.853181 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b09fb1e5-412c-4af8-a6cb-aace028a7621 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:56.057331 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b09fb1e5-412c-4af8-a6cb-aace028a7621 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:56.059986 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:56.067312 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b09fb1e5-412c-4af8-a6cb-aace028a7621 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1319 microversion: 2.1 time: 0.228296 Aug 04 10:26:56.067895 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 135/248] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:55 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:56.228232 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-2b995cac-ab7b-47fd-820a-235c89092609 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:56.229188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-2b995cac-ab7b-47fd-820a-235c89092609 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:56.239626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2b995cac-ab7b-47fd-820a-235c89092609 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:56.240332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2b995cac-ab7b-47fd-820a-235c89092609 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:56.241498 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2b995cac-ab7b-47fd-820a-235c89092609 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:56.242450 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2b995cac-ab7b-47fd-820a-235c89092609 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:56.383811 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-2b995cac-ab7b-47fd-820a-235c89092609 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:56.393345 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-2b995cac-ab7b-47fd-820a-235c89092609 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.170367 Aug 04 10:26:56.394127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 114/249] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:56 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:57.086870 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b8af23d7-4608-44fb-94bd-5a9476bed5e7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:57.088147 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b8af23d7-4608-44fb-94bd-5a9476bed5e7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:57.096669 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b8af23d7-4608-44fb-94bd-5a9476bed5e7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:57.097623 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b8af23d7-4608-44fb-94bd-5a9476bed5e7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:57.098831 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b8af23d7-4608-44fb-94bd-5a9476bed5e7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:57.099534 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b8af23d7-4608-44fb-94bd-5a9476bed5e7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:57.302037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b8af23d7-4608-44fb-94bd-5a9476bed5e7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:57.319359 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b8af23d7-4608-44fb-94bd-5a9476bed5e7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1319 microversion: 2.1 time: 0.236152 Aug 04 10:26:57.322392 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 136/250] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:57 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:57.415414 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4b69abaf-2842-4832-9aea-60d05a46d2d0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:57.416046 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4b69abaf-2842-4832-9aea-60d05a46d2d0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:57.423312 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b69abaf-2842-4832-9aea-60d05a46d2d0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:57.423828 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b69abaf-2842-4832-9aea-60d05a46d2d0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:57.424715 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b69abaf-2842-4832-9aea-60d05a46d2d0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:57.425248 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b69abaf-2842-4832-9aea-60d05a46d2d0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:57.932496 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4b69abaf-2842-4832-9aea-60d05a46d2d0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:57.940963 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4b69abaf-2842-4832-9aea-60d05a46d2d0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.529305 Aug 04 10:26:57.941545 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 115/251] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:57 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:58.342629 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4e90cefa-8999-4378-b68f-d1f98540683e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:58.343995 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4e90cefa-8999-4378-b68f-d1f98540683e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:58.355613 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4e90cefa-8999-4378-b68f-d1f98540683e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:58.356169 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4e90cefa-8999-4378-b68f-d1f98540683e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:58.356980 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4e90cefa-8999-4378-b68f-d1f98540683e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:58.357678 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4e90cefa-8999-4378-b68f-d1f98540683e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:58.627191 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4e90cefa-8999-4378-b68f-d1f98540683e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:58.635859 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4e90cefa-8999-4378-b68f-d1f98540683e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1319 microversion: 2.1 time: 0.297017 Aug 04 10:26:58.636542 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 137/252] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:58 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:58.962776 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e5b81497-4ead-42f0-bd40-9ba6ff44faa6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:58.963395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e5b81497-4ead-42f0-bd40-9ba6ff44faa6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:58.977939 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e5b81497-4ead-42f0-bd40-9ba6ff44faa6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:58.979223 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e5b81497-4ead-42f0-bd40-9ba6ff44faa6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:58.980454 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e5b81497-4ead-42f0-bd40-9ba6ff44faa6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:58.981885 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e5b81497-4ead-42f0-bd40-9ba6ff44faa6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:59.243676 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e5b81497-4ead-42f0-bd40-9ba6ff44faa6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:26:59.254843 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e5b81497-4ead-42f0-bd40-9ba6ff44faa6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.296031 Aug 04 10:26:59.256498 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 116/253] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:58 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:26:59.301882 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-54f962ad-7c14-46f3-abf3-785c09e61190 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:59.302699 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-54f962ad-7c14-46f3-abf3-785c09e61190 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:59.317232 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-54f962ad-7c14-46f3-abf3-785c09e61190 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:59.317926 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-54f962ad-7c14-46f3-abf3-785c09e61190 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:59.318912 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-54f962ad-7c14-46f3-abf3-785c09e61190 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:59.320135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-54f962ad-7c14-46f3-abf3-785c09e61190 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:59.349561 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-54f962ad-7c14-46f3-abf3-785c09e61190 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/ips" status: 200 len: 146 microversion: 2.1 time: 0.052581 Aug 04 10:26:59.358770 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 138/254] 10.222.0.72 () {58 vars in 1248 bytes} [Thu Aug 4 10:26:59 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/ips => generated 146 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:59.657250 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6faa306f-ed5c-4918-93ca-1cb603bbebbe tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:59.658013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6faa306f-ed5c-4918-93ca-1cb603bbebbe tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:59.660418 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=12 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:59.682571 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6faa306f-ed5c-4918-93ca-1cb603bbebbe tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:59.683396 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6faa306f-ed5c-4918-93ca-1cb603bbebbe tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:59.684441 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6faa306f-ed5c-4918-93ca-1cb603bbebbe tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:59.685122 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6faa306f-ed5c-4918-93ca-1cb603bbebbe tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:59.692202 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-493c33f2-0dfa-434c-869c-c394c564543f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:59.693137 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-493c33f2-0dfa-434c-869c-c394c564543f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:26:59.705407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-493c33f2-0dfa-434c-869c-c394c564543f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:59.706252 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-493c33f2-0dfa-434c-869c-c394c564543f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:59.707266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-493c33f2-0dfa-434c-869c-c394c564543f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:26:59.713383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-493c33f2-0dfa-434c-869c-c394c564543f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:26:59.770560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-493c33f2-0dfa-434c-869c-c394c564543f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/ips" status: 200 len: 153 microversion: 2.20 time: 0.082401 Aug 04 10:26:59.773203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 139/255] 10.222.0.72 () {60 vars in 1289 bytes} [Thu Aug 4 10:26:59 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/ips => generated 153 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:27:00.130171 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6faa306f-ed5c-4918-93ca-1cb603bbebbe tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:00.184632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6faa306f-ed5c-4918-93ca-1cb603bbebbe tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1319 microversion: 2.1 time: 0.530972 Aug 04 10:27:00.186228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 117/256] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:26:59 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:00.241577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-91f76e75-dee8-4e4a-a41d-65d33c54da98 req-de5de40f-bb99-407f-b130-6d3f839dae95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c66993-74b2-46a9-a9d1-c954c3d7fd2b", "name": "network-vif-plugged", "status": "completed", "tag": "c32f70f1-3ac3-48e7-a8b4-6d1ba2e8d2d2"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:00.263356 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-91f76e75-dee8-4e4a-a41d-65d33c54da98 req-de5de40f-bb99-407f-b130-6d3f839dae95 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:00.265131 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-91f76e75-dee8-4e4a-a41d-65d33c54da98 req-de5de40f-bb99-407f-b130-6d3f839dae95 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:00.276872 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ed28d463-6f74-49e0-9e29-516bdd7b24c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:00.277488 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ed28d463-6f74-49e0-9e29-516bdd7b24c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:00.290129 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ed28d463-6f74-49e0-9e29-516bdd7b24c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:00.290585 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ed28d463-6f74-49e0-9e29-516bdd7b24c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:00.291367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ed28d463-6f74-49e0-9e29-516bdd7b24c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:00.291994 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ed28d463-6f74-49e0-9e29-516bdd7b24c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:00.328679 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-91f76e75-dee8-4e4a-a41d-65d33c54da98 req-de5de40f-bb99-407f-b130-6d3f839dae95 service nova] Creating event network-vif-plugged:c32f70f1-3ac3-48e7-a8b4-6d1ba2e8d2d2 for instance 67c66993-74b2-46a9-a9d1-c954c3d7fd2b on hv-cinder-82660 Aug 04 10:27:00.337165 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-91f76e75-dee8-4e4a-a41d-65d33c54da98 req-de5de40f-bb99-407f-b130-6d3f839dae95 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097584 Aug 04 10:27:00.338345 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 140/257] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:00.809251 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-ed28d463-6f74-49e0-9e29-516bdd7b24c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:00.822628 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ed28d463-6f74-49e0-9e29-516bdd7b24c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.549706 Aug 04 10:27:00.848189 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 118/258] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:00 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:01.209170 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-df3b7abe-5ac6-44f2-86fc-d37cc0f76a54 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:01.210525 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-df3b7abe-5ac6-44f2-86fc-d37cc0f76a54 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:01.220282 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-df3b7abe-5ac6-44f2-86fc-d37cc0f76a54 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:01.223870 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-df3b7abe-5ac6-44f2-86fc-d37cc0f76a54 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:01.225318 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-df3b7abe-5ac6-44f2-86fc-d37cc0f76a54 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:01.225980 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-df3b7abe-5ac6-44f2-86fc-d37cc0f76a54 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:01.468728 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-df3b7abe-5ac6-44f2-86fc-d37cc0f76a54 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:01.485391 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-df3b7abe-5ac6-44f2-86fc-d37cc0f76a54 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1319 microversion: 2.1 time: 0.280684 Aug 04 10:27:01.486061 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 141/259] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:01 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:01.847089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-41354b5b-8e81-4e07-a755-14cb9866ced4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:01.847840 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-41354b5b-8e81-4e07-a755-14cb9866ced4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:01.857360 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-41354b5b-8e81-4e07-a755-14cb9866ced4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:01.859083 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-41354b5b-8e81-4e07-a755-14cb9866ced4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:01.860287 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-41354b5b-8e81-4e07-a755-14cb9866ced4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:01.862168 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-41354b5b-8e81-4e07-a755-14cb9866ced4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:02.187177 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-41354b5b-8e81-4e07-a755-14cb9866ced4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:02.207486 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-41354b5b-8e81-4e07-a755-14cb9866ced4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.365428 Aug 04 10:27:02.219396 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 119/260] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:01 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:02.506959 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-28f774e4-f19f-400c-b873-f38fa49a9026 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:02.508383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-28f774e4-f19f-400c-b873-f38fa49a9026 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:02.517758 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-28f774e4-f19f-400c-b873-f38fa49a9026 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:02.518198 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-28f774e4-f19f-400c-b873-f38fa49a9026 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:02.519131 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-28f774e4-f19f-400c-b873-f38fa49a9026 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:02.519563 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-28f774e4-f19f-400c-b873-f38fa49a9026 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:02.778027 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-28f774e4-f19f-400c-b873-f38fa49a9026 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:02.791144 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-28f774e4-f19f-400c-b873-f38fa49a9026 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1319 microversion: 2.1 time: 0.288138 Aug 04 10:27:02.791838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 142/261] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:02 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:02.839898 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-cdef3393-7180-480d-b8bc-249a7056c46b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:02.840798 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-cdef3393-7180-480d-b8bc-249a7056c46b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:02.847899 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cdef3393-7180-480d-b8bc-249a7056c46b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:02.849218 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cdef3393-7180-480d-b8bc-249a7056c46b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:02.851114 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cdef3393-7180-480d-b8bc-249a7056c46b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:02.851789 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cdef3393-7180-480d-b8bc-249a7056c46b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:02.870742 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-56060c4a-f3ba-4c78-b514-61baaf229e0d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:02.870742 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-56060c4a-f3ba-4c78-b514-61baaf229e0d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:02.889010 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56060c4a-f3ba-4c78-b514-61baaf229e0d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:02.894966 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56060c4a-f3ba-4c78-b514-61baaf229e0d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:02.898764 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56060c4a-f3ba-4c78-b514-61baaf229e0d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:02.901711 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56060c4a-f3ba-4c78-b514-61baaf229e0d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:02.933176 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-cdef3393-7180-480d-b8bc-249a7056c46b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lazy-loading 'flavor' on Instance uuid 0396f5e6-1b64-4b0f-9352-28165af5878b {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:27:02.961345 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-56060c4a-f3ba-4c78-b514-61baaf229e0d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/ips" status: 200 len: 150 microversion: 2.1 time: 0.096241 Aug 04 10:27:02.968602 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 143/262] 10.222.0.72 () {58 vars in 1248 bytes} [Thu Aug 4 10:27:02 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/ips => generated 150 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:03.137522 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:03.244864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6a6c6758-95a8-4053-a7e6-53679f5d890b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:03.245834 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6a6c6758-95a8-4053-a7e6-53679f5d890b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:03.253897 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:03.258826 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6a6c6758-95a8-4053-a7e6-53679f5d890b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:03.259313 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6a6c6758-95a8-4053-a7e6-53679f5d890b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:03.264801 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6a6c6758-95a8-4053-a7e6-53679f5d890b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:03.265446 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6a6c6758-95a8-4053-a7e6-53679f5d890b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:03.507431 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6a6c6758-95a8-4053-a7e6-53679f5d890b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:03.520175 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6a6c6758-95a8-4053-a7e6-53679f5d890b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.279458 Aug 04 10:27:03.541535 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 144/263] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:03 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:03.550849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-caded823-8f75-426d-b2a8-151052c940b3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b7510da-1c03-416d-9382-666a9e7bbd3d"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:03.557095 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-caded823-8f75-426d-b2a8-151052c940b3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:03.597706 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-caded823-8f75-426d-b2a8-151052c940b3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:03.609294 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-caded823-8f75-426d-b2a8-151052c940b3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:03.610414 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-caded823-8f75-426d-b2a8-151052c940b3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:03.611023 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-caded823-8f75-426d-b2a8-151052c940b3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:04.211307 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-caded823-8f75-426d-b2a8-151052c940b3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "POST /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.667069 Aug 04 10:27:04.212679 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 145/264] 10.222.0.72 () {60 vars in 1323 bytes} [Thu Aug 4 10:27:03 2022] POST /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/os-volume_attachments => generated 194 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:04.261278 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-00f61ce0-4894-4a9c-b346-fc4eddeeec1d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:04.262125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-00f61ce0-4894-4a9c-b346-fc4eddeeec1d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:04.299349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-00f61ce0-4894-4a9c-b346-fc4eddeeec1d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:04.300412 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-00f61ce0-4894-4a9c-b346-fc4eddeeec1d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:04.302669 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-00f61ce0-4894-4a9c-b346-fc4eddeeec1d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:04.303470 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-00f61ce0-4894-4a9c-b346-fc4eddeeec1d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:04.582626 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-00f61ce0-4894-4a9c-b346-fc4eddeeec1d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:04.598495 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-00f61ce0-4894-4a9c-b346-fc4eddeeec1d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1509 microversion: 2.1 time: 0.384027 Aug 04 10:27:04.613443 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 146/265] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:04 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1509 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:04.623178 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-91b93832-5f59-4ece-9d3d-1b315d300fce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:04.624654 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-91b93832-5f59-4ece-9d3d-1b315d300fce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:04.637157 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-91b93832-5f59-4ece-9d3d-1b315d300fce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:04.637929 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-91b93832-5f59-4ece-9d3d-1b315d300fce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:04.639577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-91b93832-5f59-4ece-9d3d-1b315d300fce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:04.640358 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-91b93832-5f59-4ece-9d3d-1b315d300fce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:04.837226 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-91b93832-5f59-4ece-9d3d-1b315d300fce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:04.869303 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-91b93832-5f59-4ece-9d3d-1b315d300fce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.254265 Aug 04 10:27:04.871599 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 147/266] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:04 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:04.886693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-10ebf481-7fdf-4a2b-a814-d1132e1c3b98 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd5080ab-4aa1-4813-be6b-ccbf6b2cfa41"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:04.893734 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-10ebf481-7fdf-4a2b-a814-d1132e1c3b98 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:04.916957 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-10ebf481-7fdf-4a2b-a814-d1132e1c3b98 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:04.917418 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-10ebf481-7fdf-4a2b-a814-d1132e1c3b98 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:04.918754 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-10ebf481-7fdf-4a2b-a814-d1132e1c3b98 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:04.919199 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-10ebf481-7fdf-4a2b-a814-d1132e1c3b98 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:05.398463 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-10ebf481-7fdf-4a2b-a814-d1132e1c3b98 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "POST /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.525048 Aug 04 10:27:05.399341 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 148/267] 10.222.0.72 () {60 vars in 1323 bytes} [Thu Aug 4 10:27:04 2022] POST /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-volume_attachments => generated 194 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:05.896260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1fe14ce4-2c13-4bbd-8bc7-f9f2b5776412 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:05.896956 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1fe14ce4-2c13-4bbd-8bc7-f9f2b5776412 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:05.912340 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1fe14ce4-2c13-4bbd-8bc7-f9f2b5776412 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:05.912806 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1fe14ce4-2c13-4bbd-8bc7-f9f2b5776412 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:05.913608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1fe14ce4-2c13-4bbd-8bc7-f9f2b5776412 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:05.914045 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1fe14ce4-2c13-4bbd-8bc7-f9f2b5776412 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:06.124867 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1fe14ce4-2c13-4bbd-8bc7-f9f2b5776412 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:06.138036 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1fe14ce4-2c13-4bbd-8bc7-f9f2b5776412 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.246522 Aug 04 10:27:06.140027 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 149/268] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:05 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:06.845488 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-cdef3393-7180-480d-b8bc-249a7056c46b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "POST /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/action" status: 202 len: 0 microversion: 2.20 time: 4.010921 Aug 04 10:27:06.853216 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 120/269] 10.222.0.72 () {62 vars in 1319 bytes} [Thu Aug 4 10:27:02 2022] POST /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/action => generated 0 bytes in 4020 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:27:06.860640 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-84283d5d-86e2-4505-b522-11cb53222f27 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:06.863857 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-84283d5d-86e2-4505-b522-11cb53222f27 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:06.879649 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-84283d5d-86e2-4505-b522-11cb53222f27 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:06.879649 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-84283d5d-86e2-4505-b522-11cb53222f27 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:06.881991 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-84283d5d-86e2-4505-b522-11cb53222f27 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:06.882860 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-84283d5d-86e2-4505-b522-11cb53222f27 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:07.160308 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f0c499ff-ef76-41e6-b964-9b679b85c018 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:07.160996 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f0c499ff-ef76-41e6-b964-9b679b85c018 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:07.167031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-84283d5d-86e2-4505-b522-11cb53222f27 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:07.178947 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-84283d5d-86e2-4505-b522-11cb53222f27 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:07.185829 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f0c499ff-ef76-41e6-b964-9b679b85c018 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:07.188657 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-84283d5d-86e2-4505-b522-11cb53222f27 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:07.190040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-84283d5d-86e2-4505-b522-11cb53222f27 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.333967 Aug 04 10:27:07.190308 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f0c499ff-ef76-41e6-b964-9b679b85c018 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:07.191152 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f0c499ff-ef76-41e6-b964-9b679b85c018 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:07.191764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f0c499ff-ef76-41e6-b964-9b679b85c018 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:07.194087 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 150/270] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:06 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:07.598377 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f0c499ff-ef76-41e6-b964-9b679b85c018 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:07.612902 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f0c499ff-ef76-41e6-b964-9b679b85c018 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.457207 Aug 04 10:27:07.614234 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 121/271] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:07 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:08.226224 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-83f74051-0ded-412f-88bc-8b0bc1f98785 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:08.227832 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-83f74051-0ded-412f-88bc-8b0bc1f98785 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:08.256800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-83f74051-0ded-412f-88bc-8b0bc1f98785 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:08.257523 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-83f74051-0ded-412f-88bc-8b0bc1f98785 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:08.259588 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-83f74051-0ded-412f-88bc-8b0bc1f98785 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:08.262873 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-83f74051-0ded-412f-88bc-8b0bc1f98785 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:08.289210 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:08.551778 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-83f74051-0ded-412f-88bc-8b0bc1f98785 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:08.563938 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-83f74051-0ded-412f-88bc-8b0bc1f98785 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:08.566340 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-83f74051-0ded-412f-88bc-8b0bc1f98785 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:08.568155 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-83f74051-0ded-412f-88bc-8b0bc1f98785 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.351392 Aug 04 10:27:08.569202 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 151/272] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:08 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:08.641482 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-177f179c-b8b8-440f-8de5-cb5b91ce9a5f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:08.646346 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-177f179c-b8b8-440f-8de5-cb5b91ce9a5f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:08.671214 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-177f179c-b8b8-440f-8de5-cb5b91ce9a5f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:08.674135 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-177f179c-b8b8-440f-8de5-cb5b91ce9a5f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:08.678149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-177f179c-b8b8-440f-8de5-cb5b91ce9a5f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:08.678920 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-177f179c-b8b8-440f-8de5-cb5b91ce9a5f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:09.041089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-177f179c-b8b8-440f-8de5-cb5b91ce9a5f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:09.053625 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-177f179c-b8b8-440f-8de5-cb5b91ce9a5f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.422666 Aug 04 10:27:09.056209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 122/273] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:08 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:09.591554 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f02d7ba8-67bf-4156-bc4d-ee412409946d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:09.592901 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f02d7ba8-67bf-4156-bc4d-ee412409946d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:09.604072 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f02d7ba8-67bf-4156-bc4d-ee412409946d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:09.604569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f02d7ba8-67bf-4156-bc4d-ee412409946d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:09.606613 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f02d7ba8-67bf-4156-bc4d-ee412409946d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:09.607289 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f02d7ba8-67bf-4156-bc4d-ee412409946d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:09.890906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f02d7ba8-67bf-4156-bc4d-ee412409946d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:09.907084 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f02d7ba8-67bf-4156-bc4d-ee412409946d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:09.908904 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f02d7ba8-67bf-4156-bc4d-ee412409946d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:09.910415 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f02d7ba8-67bf-4156-bc4d-ee412409946d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.323047 Aug 04 10:27:09.934077 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 152/274] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:09 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:27:10.081149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4b97d004-4aab-477f-a898-571092611ec2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:10.082473 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4b97d004-4aab-477f-a898-571092611ec2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:10.094616 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b97d004-4aab-477f-a898-571092611ec2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:10.100852 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b97d004-4aab-477f-a898-571092611ec2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:10.103256 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b97d004-4aab-477f-a898-571092611ec2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:10.105786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b97d004-4aab-477f-a898-571092611ec2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:10.393588 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4b97d004-4aab-477f-a898-571092611ec2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:10.402853 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4b97d004-4aab-477f-a898-571092611ec2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.326258 Aug 04 10:27:10.403579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 123/275] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:10 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:10.936737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-334352e8-8aa4-4b63-81a5-16966bc3ee68 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:10.937593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-334352e8-8aa4-4b63-81a5-16966bc3ee68 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:10.944226 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-334352e8-8aa4-4b63-81a5-16966bc3ee68 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:10.944961 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-334352e8-8aa4-4b63-81a5-16966bc3ee68 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:10.947193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-334352e8-8aa4-4b63-81a5-16966bc3ee68 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:10.952869 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-334352e8-8aa4-4b63-81a5-16966bc3ee68 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:11.074360 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d47d5fd5-6fa4-4f14-8dcf-c58d71785414 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Action: 'create', calling method: .version_select at 0x7fbaa52683a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-274711633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKxOiZYOEcjmvqQJGKjQGrHttb7qPOJ8YL0CLv3B44QD3lSsOZ4mpX2rIabheByFvdU2di3qh1W6gH2YDt1r3LGfrIxipoI7E0IxBFBg5u2RqFVGCgFSIqKQ7uDP8pn4w=="}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:11.113004 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-d47d5fd5-6fa4-4f14-8dcf-c58d71785414 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Getting quotas for project 82b077dd80c54b08ba3ad79b8cafd3f7. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:27:11.118011 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-d47d5fd5-6fa4-4f14-8dcf-c58d71785414 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Getting quotas for user fd829e78e710440687678701fea3cf2c and project 82b077dd80c54b08ba3ad79b8cafd3f7. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:27:11.161522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d47d5fd5-6fa4-4f14-8dcf-c58d71785414 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.379236 Aug 04 10:27:11.164080 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 153/276] 10.222.0.72 () {60 vars in 1159 bytes} [Thu Aug 4 10:27:10 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:11.242278 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-334352e8-8aa4-4b63-81a5-16966bc3ee68 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:11.261551 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-334352e8-8aa4-4b63-81a5-16966bc3ee68 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:11.265008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-334352e8-8aa4-4b63-81a5-16966bc3ee68 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:11.266797 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-334352e8-8aa4-4b63-81a5-16966bc3ee68 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.334424 Aug 04 10:27:11.280379 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 124/277] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:10 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:11.426502 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b6060d74-023f-48a6-b36a-1587750470c4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:11.427204 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b6060d74-023f-48a6-b36a-1587750470c4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:11.442642 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b6060d74-023f-48a6-b36a-1587750470c4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:11.448510 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b6060d74-023f-48a6-b36a-1587750470c4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:11.449758 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b6060d74-023f-48a6-b36a-1587750470c4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:11.450274 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b6060d74-023f-48a6-b36a-1587750470c4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:11.789594 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b6060d74-023f-48a6-b36a-1587750470c4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:11.798221 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b6060d74-023f-48a6-b36a-1587750470c4 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.375897 Aug 04 10:27:11.816351 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 154/278] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:11 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:12.305003 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d710d77e-1221-46dc-8f39-a5d052f4a2e3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:12.305646 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-d710d77e-1221-46dc-8f39-a5d052f4a2e3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:12.320732 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d710d77e-1221-46dc-8f39-a5d052f4a2e3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:12.324618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d710d77e-1221-46dc-8f39-a5d052f4a2e3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:12.325449 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d710d77e-1221-46dc-8f39-a5d052f4a2e3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:12.325901 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d710d77e-1221-46dc-8f39-a5d052f4a2e3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:12.671884 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1666107292", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1352145375", "security_groups": [{"name": "tempest-secgroup-smoke-1648023663"}], "networks": [{"uuid": "189442dc-51fd-42d4-b2e3-8e0410bb07b8"}], "block_device_mapping_v2": [{"uuid": "768777d1-0809-4268-9f68-2b82c49f616c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:13.280284 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d710d77e-1221-46dc-8f39-a5d052f4a2e3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:13.303277 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] validate_networks() for [('189442dc-51fd-42d4-b2e3-8e0410bb07b8', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:27:13.313139 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d710d77e-1221-46dc-8f39-a5d052f4a2e3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:13.315454 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d710d77e-1221-46dc-8f39-a5d052f4a2e3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:13.317276 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d710d77e-1221-46dc-8f39-a5d052f4a2e3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 1.025743 Aug 04 10:27:13.318314 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 125/279] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:12 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:13.323299 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-42a9a1f1-7619-4feb-9ccc-947bab3e4406 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:13.323944 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-42a9a1f1-7619-4feb-9ccc-947bab3e4406 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:13.326474 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:13.337237 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-42a9a1f1-7619-4feb-9ccc-947bab3e4406 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:13.338113 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-42a9a1f1-7619-4feb-9ccc-947bab3e4406 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:13.341144 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-42a9a1f1-7619-4feb-9ccc-947bab3e4406 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:13.341978 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-42a9a1f1-7619-4feb-9ccc-947bab3e4406 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:13.583362 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-42a9a1f1-7619-4feb-9ccc-947bab3e4406 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:13.591913 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-42a9a1f1-7619-4feb-9ccc-947bab3e4406 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.272350 Aug 04 10:27:13.594202 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 126/280] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:13 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:13.602867 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4b72e6b3-4a0a-4968-8035-71963bdacfbb tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:13.616591 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b72e6b3-4a0a-4968-8035-71963bdacfbb tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:13.617262 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b72e6b3-4a0a-4968-8035-71963bdacfbb tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:13.771545 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4b72e6b3-4a0a-4968-8035-71963bdacfbb tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Going to try to stop instance {{(pid=117667) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 10:27:13.872611 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4b72e6b3-4a0a-4968-8035-71963bdacfbb tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "POST /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/action" status: 202 len: 0 microversion: 2.1 time: 0.273314 Aug 04 10:27:13.875832 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 127/281] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:27:13 2022] POST /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:27:13.898064 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-3eeca768-30ce-4a74-be02-a70f5a7788a8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:13.901209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-3eeca768-30ce-4a74-be02-a70f5a7788a8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:13.919420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3eeca768-30ce-4a74-be02-a70f5a7788a8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:13.920928 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3eeca768-30ce-4a74-be02-a70f5a7788a8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:13.923811 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3eeca768-30ce-4a74-be02-a70f5a7788a8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:13.924505 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3eeca768-30ce-4a74-be02-a70f5a7788a8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:14.319709 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:27:14.320949 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:27:14.321599 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:27:14.324753 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-3eeca768-30ce-4a74-be02-a70f5a7788a8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:14.325294 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:27:14.325479 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:27:14.336139 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:14.336460 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:14.337272 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:14.337704 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:14.338687 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-3eeca768-30ce-4a74-be02-a70f5a7788a8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.452589 Aug 04 10:27:14.340004 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 128/282] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:13 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:14.347334 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-55e6fb10-6c3d-4b02-b6ab-9cb594387198 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:14.352249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-55e6fb10-6c3d-4b02-b6ab-9cb594387198 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:14.360792 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Getting quotas for project 5084c2b61ad2427d91e0fc85392aee14. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:27:14.361814 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-55e6fb10-6c3d-4b02-b6ab-9cb594387198 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:14.362533 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-55e6fb10-6c3d-4b02-b6ab-9cb594387198 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:14.363613 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-55e6fb10-6c3d-4b02-b6ab-9cb594387198 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:14.365299 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Getting quotas for user c1ecb46bae9e4e369416d138203abe6f and project 5084c2b61ad2427d91e0fc85392aee14. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:27:14.365948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-55e6fb10-6c3d-4b02-b6ab-9cb594387198 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:14.454294 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:27:14.457341 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='768777d1-0809-4268-9f68-2b82c49f616c',volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:27:14.550759 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-55e6fb10-6c3d-4b02-b6ab-9cb594387198 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:14.560366 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-55e6fb10-6c3d-4b02-b6ab-9cb594387198 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:14.562623 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-55e6fb10-6c3d-4b02-b6ab-9cb594387198 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:14.563872 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-55e6fb10-6c3d-4b02-b6ab-9cb594387198 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.222612 Aug 04 10:27:14.564631 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 129/283] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:14 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:14.618269 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b0630fe0-561d-4c61-bb69-c23245827f67 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:14.618985 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b0630fe0-561d-4c61-bb69-c23245827f67 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:14.641118 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b0630fe0-561d-4c61-bb69-c23245827f67 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:14.641644 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b0630fe0-561d-4c61-bb69-c23245827f67 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:14.642475 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b0630fe0-561d-4c61-bb69-c23245827f67 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:14.642877 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b0630fe0-561d-4c61-bb69-c23245827f67 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:14.654853 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-cb6ccd9f-f912-4307-8a41-cc55ee663eb3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.987381 Aug 04 10:27:14.657279 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 155/284] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:27:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 10:27:14.671092 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7c982f1e-7fb8-4afb-8113-3ace07f475ea tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:14.684928 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7c982f1e-7fb8-4afb-8113-3ace07f475ea tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:14.808853 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7c982f1e-7fb8-4afb-8113-3ace07f475ea tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:14.836304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7c982f1e-7fb8-4afb-8113-3ace07f475ea tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1089 microversion: 2.1 time: 0.169106 Aug 04 10:27:14.852338 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 156/285] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:14 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1089 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:14.896416 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b0630fe0-561d-4c61-bb69-c23245827f67 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:14.913561 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b0630fe0-561d-4c61-bb69-c23245827f67 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.302166 Aug 04 10:27:14.915309 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 130/286] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:14 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:15.363165 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-699b8e28-594b-4847-b4ea-fa3b1820c098 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:15.364631 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-699b8e28-594b-4847-b4ea-fa3b1820c098 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:15.372062 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-699b8e28-594b-4847-b4ea-fa3b1820c098 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:15.372866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-699b8e28-594b-4847-b4ea-fa3b1820c098 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:15.374641 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-699b8e28-594b-4847-b4ea-fa3b1820c098 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:15.375306 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-699b8e28-594b-4847-b4ea-fa3b1820c098 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:15.597695 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-bd4fe2f2-0c4d-4bb4-89b9-4b3213bc9674 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:15.598873 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-bd4fe2f2-0c4d-4bb4-89b9-4b3213bc9674 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:15.612354 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd4fe2f2-0c4d-4bb4-89b9-4b3213bc9674 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:15.613355 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd4fe2f2-0c4d-4bb4-89b9-4b3213bc9674 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:15.615440 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd4fe2f2-0c4d-4bb4-89b9-4b3213bc9674 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:15.616566 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd4fe2f2-0c4d-4bb4-89b9-4b3213bc9674 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:15.648044 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-699b8e28-594b-4847-b4ea-fa3b1820c098 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:15.664546 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-699b8e28-594b-4847-b4ea-fa3b1820c098 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.307043 Aug 04 10:27:15.666682 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 157/287] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:15 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:15.860542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bd4fe2f2-0c4d-4bb4-89b9-4b3213bc9674 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:15.865314 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-83d9d7be-53b3-4627-847e-98112743627b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:15.869647 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-83d9d7be-53b3-4627-847e-98112743627b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:15.876490 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bd4fe2f2-0c4d-4bb4-89b9-4b3213bc9674 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:15.878905 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bd4fe2f2-0c4d-4bb4-89b9-4b3213bc9674 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:15.881452 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-bd4fe2f2-0c4d-4bb4-89b9-4b3213bc9674 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.289294 Aug 04 10:27:15.895587 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-83d9d7be-53b3-4627-847e-98112743627b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:15.898494 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-83d9d7be-53b3-4627-847e-98112743627b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:15.902978 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-83d9d7be-53b3-4627-847e-98112743627b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:15.903142 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 131/288] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:15 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:15.903831 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-83d9d7be-53b3-4627-847e-98112743627b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:15.935454 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7373602e-7b4b-44df-8ffd-e07a39ebbe35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:15.937497 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7373602e-7b4b-44df-8ffd-e07a39ebbe35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:15.947906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7373602e-7b4b-44df-8ffd-e07a39ebbe35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:15.949443 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7373602e-7b4b-44df-8ffd-e07a39ebbe35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:15.953213 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7373602e-7b4b-44df-8ffd-e07a39ebbe35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:15.953847 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7373602e-7b4b-44df-8ffd-e07a39ebbe35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:16.084942 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-83d9d7be-53b3-4627-847e-98112743627b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:16.096408 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-83d9d7be-53b3-4627-847e-98112743627b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1187 microversion: 2.1 time: 0.236267 Aug 04 10:27:16.098236 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 158/289] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:15 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1187 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:16.175113 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-7373602e-7b4b-44df-8ffd-e07a39ebbe35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:16.185196 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7373602e-7b4b-44df-8ffd-e07a39ebbe35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.252399 Aug 04 10:27:16.187069 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 132/290] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:15 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:16.687456 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-13fa2953-8a6b-41a8-8979-fcec1b26b1cd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:16.688096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-13fa2953-8a6b-41a8-8979-fcec1b26b1cd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:16.698348 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13fa2953-8a6b-41a8-8979-fcec1b26b1cd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:16.699200 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13fa2953-8a6b-41a8-8979-fcec1b26b1cd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:16.701181 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13fa2953-8a6b-41a8-8979-fcec1b26b1cd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:16.703104 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13fa2953-8a6b-41a8-8979-fcec1b26b1cd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:16.913712 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5fbe5e80-de65-46ed-a109-5876de746e1e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:16.915038 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5fbe5e80-de65-46ed-a109-5876de746e1e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:16.926278 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5fbe5e80-de65-46ed-a109-5876de746e1e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:16.928694 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5fbe5e80-de65-46ed-a109-5876de746e1e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:16.934893 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5fbe5e80-de65-46ed-a109-5876de746e1e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:16.936375 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5fbe5e80-de65-46ed-a109-5876de746e1e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:17.116513 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-13fa2953-8a6b-41a8-8979-fcec1b26b1cd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:17.127426 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-13fa2953-8a6b-41a8-8979-fcec1b26b1cd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.444021 Aug 04 10:27:17.128658 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 159/291] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:16 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:17.133647 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bfde1f04-99c5-489c-9004-430adbb1ee62 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:17.134536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bfde1f04-99c5-489c-9004-430adbb1ee62 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:17.153278 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bfde1f04-99c5-489c-9004-430adbb1ee62 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:17.153964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bfde1f04-99c5-489c-9004-430adbb1ee62 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:17.154785 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bfde1f04-99c5-489c-9004-430adbb1ee62 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:17.155248 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bfde1f04-99c5-489c-9004-430adbb1ee62 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:17.302316 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bfde1f04-99c5-489c-9004-430adbb1ee62 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:17.313484 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bfde1f04-99c5-489c-9004-430adbb1ee62 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1205 microversion: 2.1 time: 0.183357 Aug 04 10:27:17.314294 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 160/292] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:17 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1205 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:17.320953 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-37c915aa-4f8f-4687-9191-7fe8a8d528bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:17.321871 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-37c915aa-4f8f-4687-9191-7fe8a8d528bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:17.334532 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5fbe5e80-de65-46ed-a109-5876de746e1e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:17.340311 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37c915aa-4f8f-4687-9191-7fe8a8d528bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:17.342429 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37c915aa-4f8f-4687-9191-7fe8a8d528bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:17.350246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5fbe5e80-de65-46ed-a109-5876de746e1e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:17.352380 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5fbe5e80-de65-46ed-a109-5876de746e1e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:17.353066 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37c915aa-4f8f-4687-9191-7fe8a8d528bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:17.353805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37c915aa-4f8f-4687-9191-7fe8a8d528bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:17.359114 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5fbe5e80-de65-46ed-a109-5876de746e1e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.450916 Aug 04 10:27:17.362748 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 133/293] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:16 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:17.547124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-37c915aa-4f8f-4687-9191-7fe8a8d528bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:17.555582 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-37c915aa-4f8f-4687-9191-7fe8a8d528bd tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.240072 Aug 04 10:27:17.557160 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 161/294] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:17 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:18.155053 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-570b51ec-bc6e-4a6f-a02a-56808978ecbd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:18.155903 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-570b51ec-bc6e-4a6f-a02a-56808978ecbd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:18.167435 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-570b51ec-bc6e-4a6f-a02a-56808978ecbd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:18.169484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-570b51ec-bc6e-4a6f-a02a-56808978ecbd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:18.171004 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-570b51ec-bc6e-4a6f-a02a-56808978ecbd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:18.174644 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-570b51ec-bc6e-4a6f-a02a-56808978ecbd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:18.347502 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9f5b1173-ac17-4116-91ac-9c38bb82ea0a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:18.352874 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9f5b1173-ac17-4116-91ac-9c38bb82ea0a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:18.381971 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9f5b1173-ac17-4116-91ac-9c38bb82ea0a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:18.384203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9f5b1173-ac17-4116-91ac-9c38bb82ea0a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:18.388053 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9f5b1173-ac17-4116-91ac-9c38bb82ea0a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:18.393227 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9f5b1173-ac17-4116-91ac-9c38bb82ea0a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:18.415783 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-570b51ec-bc6e-4a6f-a02a-56808978ecbd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:18.440994 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-570b51ec-bc6e-4a6f-a02a-56808978ecbd tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.286551 Aug 04 10:27:18.456421 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 134/295] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:18 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:18.470620 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a271b7ef-6175-4a83-ae1b-cf49b044b47d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:18.472700 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a271b7ef-6175-4a83-ae1b-cf49b044b47d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:18.486937 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a271b7ef-6175-4a83-ae1b-cf49b044b47d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:18.507941 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a271b7ef-6175-4a83-ae1b-cf49b044b47d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:18.510883 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a271b7ef-6175-4a83-ae1b-cf49b044b47d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:18.511571 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a271b7ef-6175-4a83-ae1b-cf49b044b47d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:18.525466 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:18.772736 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9f5b1173-ac17-4116-91ac-9c38bb82ea0a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:18.794158 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9f5b1173-ac17-4116-91ac-9c38bb82ea0a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1273 microversion: 2.1 time: 0.462860 Aug 04 10:27:18.798693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 162/296] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:18 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1273 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:18.805172 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0c027ea2-cabe-4e2c-b9fe-1a07ea66901c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:18.809139 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0c027ea2-cabe-4e2c-b9fe-1a07ea66901c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:18.821810 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0c027ea2-cabe-4e2c-b9fe-1a07ea66901c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:18.822819 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0c027ea2-cabe-4e2c-b9fe-1a07ea66901c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:18.824418 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0c027ea2-cabe-4e2c-b9fe-1a07ea66901c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:18.825151 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0c027ea2-cabe-4e2c-b9fe-1a07ea66901c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:18.972405 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a271b7ef-6175-4a83-ae1b-cf49b044b47d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:19.004004 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a271b7ef-6175-4a83-ae1b-cf49b044b47d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:19.008660 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a271b7ef-6175-4a83-ae1b-cf49b044b47d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:19.011049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a271b7ef-6175-4a83-ae1b-cf49b044b47d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.553102 Aug 04 10:27:19.012948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 135/297] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:18 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:19.018651 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-ebd2be96-689d-4c3e-b9f8-709d0e04c993 req-8c812b5e-58f6-4985-9568-28f4ed1f3518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e129c5-a1f4-418e-a7c7-8840c88c20e9", "tag": "99b65378-21c4-446f-87b5-bc67e1fde387"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:19.033862 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-ebd2be96-689d-4c3e-b9f8-709d0e04c993 req-8c812b5e-58f6-4985-9568-28f4ed1f3518 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:19.034677 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-ebd2be96-689d-4c3e-b9f8-709d0e04c993 req-8c812b5e-58f6-4985-9568-28f4ed1f3518 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:19.051833 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-ebd2be96-689d-4c3e-b9f8-709d0e04c993 req-8c812b5e-58f6-4985-9568-28f4ed1f3518 service nova] Creating event network-changed:99b65378-21c4-446f-87b5-bc67e1fde387 for instance 34e129c5-a1f4-418e-a7c7-8840c88c20e9 on hv-cinder-82660 Aug 04 10:27:19.063649 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-ebd2be96-689d-4c3e-b9f8-709d0e04c993 req-8c812b5e-58f6-4985-9568-28f4ed1f3518 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047604 Aug 04 10:27:19.064957 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 136/298] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:19.109645 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0c027ea2-cabe-4e2c-b9fe-1a07ea66901c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:19.118122 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0c027ea2-cabe-4e2c-b9fe-1a07ea66901c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.317181 Aug 04 10:27:19.119238 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 163/299] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:18 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:19.471068 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-21945194-5b22-4018-b66c-d1a9a98abf7f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:19.472618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-21945194-5b22-4018-b66c-d1a9a98abf7f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:19.480014 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-21945194-5b22-4018-b66c-d1a9a98abf7f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:19.480478 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-21945194-5b22-4018-b66c-d1a9a98abf7f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:19.481602 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-21945194-5b22-4018-b66c-d1a9a98abf7f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:19.483068 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-21945194-5b22-4018-b66c-d1a9a98abf7f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:19.676966 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-21945194-5b22-4018-b66c-d1a9a98abf7f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:19.694964 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-21945194-5b22-4018-b66c-d1a9a98abf7f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.228647 Aug 04 10:27:19.696574 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 137/300] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:19 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:19.757621 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2f3d27c0-9289-4661-bafb-5155b82d9636 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Action: 'create', calling method: .version_select at 0x7fbaa780af70>, body: {"keypair": {"name": "tempest-keypair-333771551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXSloAtcL5G1MQmztukcwVbHR7HNT+J/1gF7vMdBw7CHcyixtb+1dfPmgfXW82//M7pCtVO2D/TJFSZWf8eFu0ivX12m2Rc4wifGQ+2C8CkOvGRTGzYFU4MDDpaIvgHTg=="}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:19.791034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-2f3d27c0-9289-4661-bafb-5155b82d9636 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:27:19.798600 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-2f3d27c0-9289-4661-bafb-5155b82d9636 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for user b680411b142642b7acc3585d2481f880 and project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:27:19.818997 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-86df20b5-a5d3-4929-8ad4-9bc088311328 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:19.819572 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-86df20b5-a5d3-4929-8ad4-9bc088311328 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:19.833779 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-86df20b5-a5d3-4929-8ad4-9bc088311328 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:19.834520 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-86df20b5-a5d3-4929-8ad4-9bc088311328 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:19.837021 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-86df20b5-a5d3-4929-8ad4-9bc088311328 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:19.837791 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-86df20b5-a5d3-4929-8ad4-9bc088311328 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:19.882069 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2f3d27c0-9289-4661-bafb-5155b82d9636 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128581 Aug 04 10:27:19.883034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 164/301] 10.222.0.72 () {60 vars in 1159 bytes} [Thu Aug 4 10:27:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:20.044458 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-855fd329-e39d-4c2d-b50b-7f306d95ecc7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:20.045470 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-855fd329-e39d-4c2d-b50b-7f306d95ecc7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:20.058997 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-855fd329-e39d-4c2d-b50b-7f306d95ecc7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:20.063553 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-855fd329-e39d-4c2d-b50b-7f306d95ecc7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:20.064711 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-855fd329-e39d-4c2d-b50b-7f306d95ecc7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:20.065940 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-855fd329-e39d-4c2d-b50b-7f306d95ecc7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:20.183454 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-86df20b5-a5d3-4929-8ad4-9bc088311328 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:20.193437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-86df20b5-a5d3-4929-8ad4-9bc088311328 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1273 microversion: 2.1 time: 0.379230 Aug 04 10:27:20.194043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 138/302] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:19 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1273 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:20.213048 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-742aa7d4-35cb-45b2-8b75-6d56d062a0b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:20.213890 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-742aa7d4-35cb-45b2-8b75-6d56d062a0b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:20.222389 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-742aa7d4-35cb-45b2-8b75-6d56d062a0b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:20.223117 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-742aa7d4-35cb-45b2-8b75-6d56d062a0b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:20.224190 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-742aa7d4-35cb-45b2-8b75-6d56d062a0b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:20.224852 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-742aa7d4-35cb-45b2-8b75-6d56d062a0b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:20.405059 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-855fd329-e39d-4c2d-b50b-7f306d95ecc7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:20.422737 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-855fd329-e39d-4c2d-b50b-7f306d95ecc7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:20.429957 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-855fd329-e39d-4c2d-b50b-7f306d95ecc7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:20.432230 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-855fd329-e39d-4c2d-b50b-7f306d95ecc7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.396080 Aug 04 10:27:20.440202 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 165/303] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:20 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:20.485754 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-742aa7d4-35cb-45b2-8b75-6d56d062a0b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:20.496763 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-742aa7d4-35cb-45b2-8b75-6d56d062a0b8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.287663 Aug 04 10:27:20.510505 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 139/304] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:20 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:20.718705 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bc3cbb4d-8872-4a91-886e-945bd933b34b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:20.719443 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bc3cbb4d-8872-4a91-886e-945bd933b34b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:20.725806 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bc3cbb4d-8872-4a91-886e-945bd933b34b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:20.726435 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bc3cbb4d-8872-4a91-886e-945bd933b34b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:20.727444 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bc3cbb4d-8872-4a91-886e-945bd933b34b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:20.728204 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bc3cbb4d-8872-4a91-886e-945bd933b34b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:20.900583 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bc3cbb4d-8872-4a91-886e-945bd933b34b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:20.909241 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bc3cbb4d-8872-4a91-886e-945bd933b34b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.195174 Aug 04 10:27:20.928393 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 166/305] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:20 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:21.215871 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d3e5c733-baaa-43e4-8f3e-eb86e003fd69 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:21.217471 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-d3e5c733-baaa-43e4-8f3e-eb86e003fd69 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:21.225843 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d3e5c733-baaa-43e4-8f3e-eb86e003fd69 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:21.226680 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d3e5c733-baaa-43e4-8f3e-eb86e003fd69 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:21.227554 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d3e5c733-baaa-43e4-8f3e-eb86e003fd69 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:21.228307 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d3e5c733-baaa-43e4-8f3e-eb86e003fd69 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:21.390231 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d3e5c733-baaa-43e4-8f3e-eb86e003fd69 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:21.398309 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d3e5c733-baaa-43e4-8f3e-eb86e003fd69 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1261 microversion: 2.1 time: 0.187452 Aug 04 10:27:21.400555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 140/306] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:21 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:21.464366 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-80e52133-939e-4308-82e8-46806c1d329c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:21.464366 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-80e52133-939e-4308-82e8-46806c1d329c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:21.470886 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-80e52133-939e-4308-82e8-46806c1d329c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:21.472052 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-80e52133-939e-4308-82e8-46806c1d329c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:21.473202 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-80e52133-939e-4308-82e8-46806c1d329c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:21.473868 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-80e52133-939e-4308-82e8-46806c1d329c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:21.520308 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-179eee59-bb98-4bca-93af-be72a6413555 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:21.520979 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-179eee59-bb98-4bca-93af-be72a6413555 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:21.532858 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-179eee59-bb98-4bca-93af-be72a6413555 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:21.533330 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-179eee59-bb98-4bca-93af-be72a6413555 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:21.534134 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-179eee59-bb98-4bca-93af-be72a6413555 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:21.534582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-179eee59-bb98-4bca-93af-be72a6413555 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:21.746797 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-80e52133-939e-4308-82e8-46806c1d329c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:21.756084 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-80e52133-939e-4308-82e8-46806c1d329c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:21.757994 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-80e52133-939e-4308-82e8-46806c1d329c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:21.759721 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-80e52133-939e-4308-82e8-46806c1d329c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.300826 Aug 04 10:27:21.760868 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 167/307] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:21 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:21.788360 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-179eee59-bb98-4bca-93af-be72a6413555 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:21.797440 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-179eee59-bb98-4bca-93af-be72a6413555 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.281297 Aug 04 10:27:21.811452 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 141/308] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:21 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:21.942000 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a7d1bb6a-8f36-4fee-8c15-7030945e009a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:21.943299 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a7d1bb6a-8f36-4fee-8c15-7030945e009a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:21.951733 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a7d1bb6a-8f36-4fee-8c15-7030945e009a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:21.952632 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a7d1bb6a-8f36-4fee-8c15-7030945e009a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:21.953428 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a7d1bb6a-8f36-4fee-8c15-7030945e009a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:21.954021 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a7d1bb6a-8f36-4fee-8c15-7030945e009a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:22.165471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a7d1bb6a-8f36-4fee-8c15-7030945e009a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:22.178545 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a7d1bb6a-8f36-4fee-8c15-7030945e009a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.240139 Aug 04 10:27:22.186853 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 168/309] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:21 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:22.209516 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1690637441", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "efa95d14-4335-4752-bcd1-62814f92872f"}], "security_groups": [{"name": "tempest-securitygroup--945220960"}], "key_name": "tempest-keypair-333771551", "user_data": "}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:22.425664 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c9fb623c-84d5-4968-8c68-b0b239bcddfd tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:22.426606 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c9fb623c-84d5-4968-8c68-b0b239bcddfd tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:22.433031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c9fb623c-84d5-4968-8c68-b0b239bcddfd tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:22.433484 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c9fb623c-84d5-4968-8c68-b0b239bcddfd tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:22.434331 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c9fb623c-84d5-4968-8c68-b0b239bcddfd tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:22.434776 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c9fb623c-84d5-4968-8c68-b0b239bcddfd tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:22.595903 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c9fb623c-84d5-4968-8c68-b0b239bcddfd tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:22.604234 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c9fb623c-84d5-4968-8c68-b0b239bcddfd tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1261 microversion: 2.1 time: 0.183133 Aug 04 10:27:22.606130 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 169/310] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:22 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:22.785502 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-38952b81-9ec4-410a-897f-36f8ea954972 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:22.786116 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-38952b81-9ec4-410a-897f-36f8ea954972 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:22.792583 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-38952b81-9ec4-410a-897f-36f8ea954972 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:22.793105 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-38952b81-9ec4-410a-897f-36f8ea954972 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:22.793944 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-38952b81-9ec4-410a-897f-36f8ea954972 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:22.794477 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-38952b81-9ec4-410a-897f-36f8ea954972 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:22.933559 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-38952b81-9ec4-410a-897f-36f8ea954972 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:22.942380 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-38952b81-9ec4-410a-897f-36f8ea954972 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:22.943932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-38952b81-9ec4-410a-897f-36f8ea954972 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:22.945097 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-38952b81-9ec4-410a-897f-36f8ea954972 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.163512 Aug 04 10:27:22.945671 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 170/311] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:22 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:27:22.950210 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-01e11e4d-5631-4b9a-a64a-f819d779b3d9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:22.950803 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-01e11e4d-5631-4b9a-a64a-f819d779b3d9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:22.957754 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-01e11e4d-5631-4b9a-a64a-f819d779b3d9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:22.958233 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-01e11e4d-5631-4b9a-a64a-f819d779b3d9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:22.958990 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-01e11e4d-5631-4b9a-a64a-f819d779b3d9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:22.959422 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-01e11e4d-5631-4b9a-a64a-f819d779b3d9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:23.105386 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-01e11e4d-5631-4b9a-a64a-f819d779b3d9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:23.108266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:23.115640 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-01e11e4d-5631-4b9a-a64a-f819d779b3d9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.168988 Aug 04 10:27:23.116445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 171/312] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:22 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:23.202606 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cb226d8b-8991-473a-a938-d6ac6accdbca tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:23.203319 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-cb226d8b-8991-473a-a938-d6ac6accdbca tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:23.209983 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb226d8b-8991-473a-a938-d6ac6accdbca tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:23.210435 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb226d8b-8991-473a-a938-d6ac6accdbca tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:23.211197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb226d8b-8991-473a-a938-d6ac6accdbca tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:23.211632 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cb226d8b-8991-473a-a938-d6ac6accdbca tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:23.359489 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-cb226d8b-8991-473a-a938-d6ac6accdbca tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:23.367429 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-cb226d8b-8991-473a-a938-d6ac6accdbca tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.168705 Aug 04 10:27:23.368097 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 172/313] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:23 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:23.625222 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e8cd97d4-bcbd-4eb7-ac4d-8f7e838fabf5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:23.625929 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e8cd97d4-bcbd-4eb7-ac4d-8f7e838fabf5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:23.633887 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e8cd97d4-bcbd-4eb7-ac4d-8f7e838fabf5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:23.634327 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e8cd97d4-bcbd-4eb7-ac4d-8f7e838fabf5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:23.635121 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e8cd97d4-bcbd-4eb7-ac4d-8f7e838fabf5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:23.635544 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e8cd97d4-bcbd-4eb7-ac4d-8f7e838fabf5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:23.782765 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e8cd97d4-bcbd-4eb7-ac4d-8f7e838fabf5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:23.790618 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e8cd97d4-bcbd-4eb7-ac4d-8f7e838fabf5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1261 microversion: 2.1 time: 0.169441 Aug 04 10:27:23.791268 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 173/314] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:23 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:23.967664 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ddbb9691-33d2-4712-b7c0-70b3f2f938b2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:23.968471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ddbb9691-33d2-4712-b7c0-70b3f2f938b2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:23.975252 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ddbb9691-33d2-4712-b7c0-70b3f2f938b2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:23.975729 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ddbb9691-33d2-4712-b7c0-70b3f2f938b2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:23.976596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ddbb9691-33d2-4712-b7c0-70b3f2f938b2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:23.977125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ddbb9691-33d2-4712-b7c0-70b3f2f938b2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:24.122622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ddbb9691-33d2-4712-b7c0-70b3f2f938b2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:24.131657 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ddbb9691-33d2-4712-b7c0-70b3f2f938b2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:24.132958 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ddbb9691-33d2-4712-b7c0-70b3f2f938b2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:24.134118 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ddbb9691-33d2-4712-b7c0-70b3f2f938b2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.170404 Aug 04 10:27:24.134665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 174/315] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:23 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:27:24.139679 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f0978605-af6d-41c0-99eb-a4710d03ee1e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:24.140296 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f0978605-af6d-41c0-99eb-a4710d03ee1e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:24.142081 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:24.148540 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f0978605-af6d-41c0-99eb-a4710d03ee1e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:24.149187 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f0978605-af6d-41c0-99eb-a4710d03ee1e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:24.149997 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f0978605-af6d-41c0-99eb-a4710d03ee1e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:24.150550 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f0978605-af6d-41c0-99eb-a4710d03ee1e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:24.298594 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f0978605-af6d-41c0-99eb-a4710d03ee1e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:24.307042 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f0978605-af6d-41c0-99eb-a4710d03ee1e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.171358 Aug 04 10:27:24.307603 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 175/316] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:24 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:24.389614 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-140b4eb6-29e8-4953-84c5-710d6e3afebc tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:24.390368 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-140b4eb6-29e8-4953-84c5-710d6e3afebc tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:24.392291 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:24.398213 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-140b4eb6-29e8-4953-84c5-710d6e3afebc tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:24.398999 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-140b4eb6-29e8-4953-84c5-710d6e3afebc tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:24.400255 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-140b4eb6-29e8-4953-84c5-710d6e3afebc tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:24.400789 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-140b4eb6-29e8-4953-84c5-710d6e3afebc tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:24.592240 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-140b4eb6-29e8-4953-84c5-710d6e3afebc tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:24.600673 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-140b4eb6-29e8-4953-84c5-710d6e3afebc tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.215163 Aug 04 10:27:24.601537 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 176/317] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:24 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:24.625665 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.network.neutron [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] validate_networks() for [('efa95d14-4335-4752-bcd1-62814f92872f', None, None, None, None, None)] {{(pid=117667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:27:24.812747 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fca3fd3f-146d-479b-af42-bf5813839c29 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:24.813634 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fca3fd3f-146d-479b-af42-bf5813839c29 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:24.823635 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fca3fd3f-146d-479b-af42-bf5813839c29 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:24.824995 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fca3fd3f-146d-479b-af42-bf5813839c29 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:24.826942 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fca3fd3f-146d-479b-af42-bf5813839c29 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:24.828005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fca3fd3f-146d-479b-af42-bf5813839c29 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:25.101951 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fca3fd3f-146d-479b-af42-bf5813839c29 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:25.112987 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fca3fd3f-146d-479b-af42-bf5813839c29 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1261 microversion: 2.1 time: 0.304879 Aug 04 10:27:25.113897 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 177/318] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:24 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1261 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:25.158795 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6aad1aae-3e9b-4352-b889-4d68e81f7370 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:25.159393 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6aad1aae-3e9b-4352-b889-4d68e81f7370 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:25.169066 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6aad1aae-3e9b-4352-b889-4d68e81f7370 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:25.169508 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6aad1aae-3e9b-4352-b889-4d68e81f7370 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:25.171288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6aad1aae-3e9b-4352-b889-4d68e81f7370 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:25.171836 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6aad1aae-3e9b-4352-b889-4d68e81f7370 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:25.230730 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Flavor limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:27:25.231160 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Image limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:27:25.231662 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Flavor pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:27:25.232102 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Image pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:27:25.233402 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:27:25.249200 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:25.251535 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:25.252610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:25.253011 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:25.278335 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:27:25.282741 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for user b680411b142642b7acc3585d2481f880 and project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:27:25.296732 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Going to run 1 instances... {{(pid=117667) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:27:25.299708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:27:25.346046 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6aad1aae-3e9b-4352-b889-4d68e81f7370 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:25.356779 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6aad1aae-3e9b-4352-b889-4d68e81f7370 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:25.359342 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6aad1aae-3e9b-4352-b889-4d68e81f7370 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:25.360851 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6aad1aae-3e9b-4352-b889-4d68e81f7370 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.206012 Aug 04 10:27:25.361953 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 178/319] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:25 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:27:25.371029 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7262a83b-dbee-4916-986e-960bca557d6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.165836 Aug 04 10:27:25.377312 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 142/320] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:27:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 3167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:27:25.377450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-151a40f8-f403-4c44-bb7a-8cb9f926481b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:25.377450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-151a40f8-f403-4c44-bb7a-8cb9f926481b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:25.382933 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-83270af1-3990-45dc-b4be-121329a8d8e6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:25.383541 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-83270af1-3990-45dc-b4be-121329a8d8e6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:25.390256 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-151a40f8-f403-4c44-bb7a-8cb9f926481b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:25.390707 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-151a40f8-f403-4c44-bb7a-8cb9f926481b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:25.391633 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-151a40f8-f403-4c44-bb7a-8cb9f926481b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:25.392105 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-151a40f8-f403-4c44-bb7a-8cb9f926481b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:25.468288 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-83270af1-3990-45dc-b4be-121329a8d8e6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:25.477531 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-83270af1-3990-45dc-b4be-121329a8d8e6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1241 microversion: 2.1 time: 0.097412 Aug 04 10:27:25.490117 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 143/321] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:25 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:25.590560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-151a40f8-f403-4c44-bb7a-8cb9f926481b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:25.603222 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-151a40f8-f403-4c44-bb7a-8cb9f926481b tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.239288 Aug 04 10:27:25.604967 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 179/322] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:25 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:25.623613 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-fc7723d2-9cea-40da-b0f1-af2fe8e295e3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:25.624259 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-fc7723d2-9cea-40da-b0f1-af2fe8e295e3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:25.631638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fc7723d2-9cea-40da-b0f1-af2fe8e295e3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:25.632496 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fc7723d2-9cea-40da-b0f1-af2fe8e295e3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:25.632929 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fc7723d2-9cea-40da-b0f1-af2fe8e295e3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:25.633367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fc7723d2-9cea-40da-b0f1-af2fe8e295e3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:25.804912 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-fc7723d2-9cea-40da-b0f1-af2fe8e295e3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:25.817132 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-fc7723d2-9cea-40da-b0f1-af2fe8e295e3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.198120 Aug 04 10:27:25.819044 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 144/323] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:25 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:26.136462 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-90c45403-7278-4445-afa1-9be25cbdf67f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:26.137151 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-90c45403-7278-4445-afa1-9be25cbdf67f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:26.145627 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90c45403-7278-4445-afa1-9be25cbdf67f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:26.146101 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90c45403-7278-4445-afa1-9be25cbdf67f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:26.146886 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90c45403-7278-4445-afa1-9be25cbdf67f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:26.148487 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90c45403-7278-4445-afa1-9be25cbdf67f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:26.297415 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-90c45403-7278-4445-afa1-9be25cbdf67f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:26.305249 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-90c45403-7278-4445-afa1-9be25cbdf67f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1261 microversion: 2.1 time: 0.172881 Aug 04 10:27:26.306097 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 180/324] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:26 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:26.385049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-adfa5f35-1ff9-44b5-b818-aad5ae9d0cb2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:26.385835 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-adfa5f35-1ff9-44b5-b818-aad5ae9d0cb2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:26.392844 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-adfa5f35-1ff9-44b5-b818-aad5ae9d0cb2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:26.393394 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-adfa5f35-1ff9-44b5-b818-aad5ae9d0cb2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:26.394540 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-adfa5f35-1ff9-44b5-b818-aad5ae9d0cb2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:26.395190 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-adfa5f35-1ff9-44b5-b818-aad5ae9d0cb2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:26.500088 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1b0e4c05-c038-4e55-a587-b247c0e4c0e2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:26.500700 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1b0e4c05-c038-4e55-a587-b247c0e4c0e2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:26.507390 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1b0e4c05-c038-4e55-a587-b247c0e4c0e2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:26.507840 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1b0e4c05-c038-4e55-a587-b247c0e4c0e2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:26.508837 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1b0e4c05-c038-4e55-a587-b247c0e4c0e2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:26.509498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1b0e4c05-c038-4e55-a587-b247c0e4c0e2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:26.542941 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-adfa5f35-1ff9-44b5-b818-aad5ae9d0cb2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:26.553205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-adfa5f35-1ff9-44b5-b818-aad5ae9d0cb2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:26.557382 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-adfa5f35-1ff9-44b5-b818-aad5ae9d0cb2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:26.558904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-adfa5f35-1ff9-44b5-b818-aad5ae9d0cb2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.177847 Aug 04 10:27:26.559480 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 145/325] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:26 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:26.582660 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1b0e4c05-c038-4e55-a587-b247c0e4c0e2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:26.591906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1b0e4c05-c038-4e55-a587-b247c0e4c0e2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1245 microversion: 2.1 time: 0.095655 Aug 04 10:27:26.592507 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 181/326] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:26 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:26.628231 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0614ae22-c8b7-4998-be82-e4aeb137d672 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:26.628231 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0614ae22-c8b7-4998-be82-e4aeb137d672 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:26.634451 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0614ae22-c8b7-4998-be82-e4aeb137d672 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:26.635342 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0614ae22-c8b7-4998-be82-e4aeb137d672 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:26.635728 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0614ae22-c8b7-4998-be82-e4aeb137d672 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:26.636186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0614ae22-c8b7-4998-be82-e4aeb137d672 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:26.788852 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0614ae22-c8b7-4998-be82-e4aeb137d672 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:26.797223 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0614ae22-c8b7-4998-be82-e4aeb137d672 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.175793 Aug 04 10:27:26.797789 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 146/327] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:26 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:26.839806 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-eda2f605-0618-4fcd-8b70-41661df13908 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:26.840785 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-eda2f605-0618-4fcd-8b70-41661df13908 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:26.847407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eda2f605-0618-4fcd-8b70-41661df13908 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:26.847994 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eda2f605-0618-4fcd-8b70-41661df13908 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:26.849012 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eda2f605-0618-4fcd-8b70-41661df13908 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:26.849563 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eda2f605-0618-4fcd-8b70-41661df13908 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:26.997645 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-eda2f605-0618-4fcd-8b70-41661df13908 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:27.005787 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-eda2f605-0618-4fcd-8b70-41661df13908 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.169986 Aug 04 10:27:27.006356 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 182/328] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:26 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:27.329541 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-95b9651e-cbdf-4d77-bc77-815f350c2ce5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:27.330208 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-95b9651e-cbdf-4d77-bc77-815f350c2ce5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:27.339946 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-95b9651e-cbdf-4d77-bc77-815f350c2ce5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:27.340425 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-95b9651e-cbdf-4d77-bc77-815f350c2ce5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:27.341210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-95b9651e-cbdf-4d77-bc77-815f350c2ce5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:27.342187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-95b9651e-cbdf-4d77-bc77-815f350c2ce5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:27.506386 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-95b9651e-cbdf-4d77-bc77-815f350c2ce5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:27.521304 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-95b9651e-cbdf-4d77-bc77-815f350c2ce5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1261 microversion: 2.1 time: 0.189832 Aug 04 10:27:27.528395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 147/329] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:27 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:27.584010 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fc4f2102-c6c7-4d5e-8bf6-c7dd176342bc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:27.585507 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fc4f2102-c6c7-4d5e-8bf6-c7dd176342bc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:27.598442 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc4f2102-c6c7-4d5e-8bf6-c7dd176342bc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:27.599235 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc4f2102-c6c7-4d5e-8bf6-c7dd176342bc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:27.601068 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc4f2102-c6c7-4d5e-8bf6-c7dd176342bc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:27.601778 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc4f2102-c6c7-4d5e-8bf6-c7dd176342bc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:27.615517 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-3bdd1727-8b58-4dbb-b260-8ec6f11493f2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:27.617377 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-3bdd1727-8b58-4dbb-b260-8ec6f11493f2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:27.631817 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3bdd1727-8b58-4dbb-b260-8ec6f11493f2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:27.632895 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3bdd1727-8b58-4dbb-b260-8ec6f11493f2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:27.634564 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3bdd1727-8b58-4dbb-b260-8ec6f11493f2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:27.636405 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3bdd1727-8b58-4dbb-b260-8ec6f11493f2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:27.737542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-3bdd1727-8b58-4dbb-b260-8ec6f11493f2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:27.746604 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-3bdd1727-8b58-4dbb-b260-8ec6f11493f2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1293 microversion: 2.1 time: 0.137390 Aug 04 10:27:27.748787 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 148/330] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:27 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1293 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:27.802745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fc4f2102-c6c7-4d5e-8bf6-c7dd176342bc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:27.817931 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fc4f2102-c6c7-4d5e-8bf6-c7dd176342bc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:27.819812 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fc4f2102-c6c7-4d5e-8bf6-c7dd176342bc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:27.820602 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9d74ebbb-726c-4330-aac6-8777d5d56427 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:27.821236 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fc4f2102-c6c7-4d5e-8bf6-c7dd176342bc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.243928 Aug 04 10:27:27.822158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9d74ebbb-726c-4330-aac6-8777d5d56427 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:27.823588 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 183/331] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:27 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:27.831485 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9d74ebbb-726c-4330-aac6-8777d5d56427 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:27.832302 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9d74ebbb-726c-4330-aac6-8777d5d56427 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:27.833296 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9d74ebbb-726c-4330-aac6-8777d5d56427 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:27.833964 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9d74ebbb-726c-4330-aac6-8777d5d56427 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:28.005836 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9d74ebbb-726c-4330-aac6-8777d5d56427 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:28.015202 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9d74ebbb-726c-4330-aac6-8777d5d56427 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.199852 Aug 04 10:27:28.032514 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ec53baa9-a2f7-4be4-b399-e84277849009 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:28.033364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ec53baa9-a2f7-4be4-b399-e84277849009 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:28.036042 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 149/332] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:27 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:28.041352 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ec53baa9-a2f7-4be4-b399-e84277849009 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:28.041940 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ec53baa9-a2f7-4be4-b399-e84277849009 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:28.042838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ec53baa9-a2f7-4be4-b399-e84277849009 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:28.043332 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ec53baa9-a2f7-4be4-b399-e84277849009 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:28.193819 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ec53baa9-a2f7-4be4-b399-e84277849009 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:28.203237 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ec53baa9-a2f7-4be4-b399-e84277849009 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.177488 Aug 04 10:27:28.203885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 184/333] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:28 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:28.536940 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-2253a523-8afb-4e71-bbfe-72681d226e0e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:28.537886 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-2253a523-8afb-4e71-bbfe-72681d226e0e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:28.545901 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2253a523-8afb-4e71-bbfe-72681d226e0e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:28.546346 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2253a523-8afb-4e71-bbfe-72681d226e0e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:28.547149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2253a523-8afb-4e71-bbfe-72681d226e0e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:28.547577 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2253a523-8afb-4e71-bbfe-72681d226e0e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:28.689874 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-2253a523-8afb-4e71-bbfe-72681d226e0e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:28.697998 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-2253a523-8afb-4e71-bbfe-72681d226e0e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1261 microversion: 2.1 time: 0.165295 Aug 04 10:27:28.698566 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 150/334] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:28 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:28.773089 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-baf03c86-8e8e-47ea-b271-d084cdb038a5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:28.773789 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-baf03c86-8e8e-47ea-b271-d084cdb038a5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:28.780903 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-baf03c86-8e8e-47ea-b271-d084cdb038a5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:28.781350 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-baf03c86-8e8e-47ea-b271-d084cdb038a5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:28.782252 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-baf03c86-8e8e-47ea-b271-d084cdb038a5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:28.782694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-baf03c86-8e8e-47ea-b271-d084cdb038a5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:28.846056 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-089ede85-172f-4613-befd-a4dd77915817 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:28.846919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-089ede85-172f-4613-befd-a4dd77915817 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:28.854290 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-089ede85-172f-4613-befd-a4dd77915817 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:28.855073 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-089ede85-172f-4613-befd-a4dd77915817 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:28.855836 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-089ede85-172f-4613-befd-a4dd77915817 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:28.856329 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-089ede85-172f-4613-befd-a4dd77915817 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:28.868661 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-baf03c86-8e8e-47ea-b271-d084cdb038a5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:28.876397 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-baf03c86-8e8e-47ea-b271-d084cdb038a5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1311 microversion: 2.1 time: 0.107322 Aug 04 10:27:28.886773 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 185/335] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:28 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:29.011226 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-089ede85-172f-4613-befd-a4dd77915817 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:29.019475 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-089ede85-172f-4613-befd-a4dd77915817 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:29.021061 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-089ede85-172f-4613-befd-a4dd77915817 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:29.022230 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-089ede85-172f-4613-befd-a4dd77915817 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1745 microversion: 2.20 time: 0.180767 Aug 04 10:27:29.022789 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 151/336] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:28 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:29.039014 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fbccf0d6-da49-47b0-b996-31090fb74398 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:29.039937 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fbccf0d6-da49-47b0-b996-31090fb74398 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:29.047007 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fbccf0d6-da49-47b0-b996-31090fb74398 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:29.047007 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fbccf0d6-da49-47b0-b996-31090fb74398 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:29.047366 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fbccf0d6-da49-47b0-b996-31090fb74398 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:29.047801 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fbccf0d6-da49-47b0-b996-31090fb74398 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:29.195328 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fbccf0d6-da49-47b0-b996-31090fb74398 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:29.208432 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fbccf0d6-da49-47b0-b996-31090fb74398 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.174178 Aug 04 10:27:29.223423 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 186/337] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:29 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:29.225895 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-495c2d99-45e6-4312-9f91-56fd8cbaaa74 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:29.226576 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-495c2d99-45e6-4312-9f91-56fd8cbaaa74 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:29.235123 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-495c2d99-45e6-4312-9f91-56fd8cbaaa74 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:29.235569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-495c2d99-45e6-4312-9f91-56fd8cbaaa74 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:29.236364 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-495c2d99-45e6-4312-9f91-56fd8cbaaa74 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:29.237521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-495c2d99-45e6-4312-9f91-56fd8cbaaa74 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:29.381709 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-495c2d99-45e6-4312-9f91-56fd8cbaaa74 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:29.390386 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-495c2d99-45e6-4312-9f91-56fd8cbaaa74 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.168377 Aug 04 10:27:29.390953 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 152/338] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:29 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:29.719021 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-91063972-bdc6-4c39-8fa6-17d7aa4c80bb tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:29.719571 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-91063972-bdc6-4c39-8fa6-17d7aa4c80bb tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:29.732913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-91063972-bdc6-4c39-8fa6-17d7aa4c80bb tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:29.733370 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-91063972-bdc6-4c39-8fa6-17d7aa4c80bb tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:29.734149 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-91063972-bdc6-4c39-8fa6-17d7aa4c80bb tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:29.734587 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-91063972-bdc6-4c39-8fa6-17d7aa4c80bb tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:29.842787 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=16 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:29.898066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ad4cec55-dc78-4fbd-89ef-8e3cf113a024 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:29.898612 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ad4cec55-dc78-4fbd-89ef-8e3cf113a024 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:29.906238 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ad4cec55-dc78-4fbd-89ef-8e3cf113a024 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:29.906691 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ad4cec55-dc78-4fbd-89ef-8e3cf113a024 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:29.907459 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ad4cec55-dc78-4fbd-89ef-8e3cf113a024 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:29.909493 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ad4cec55-dc78-4fbd-89ef-8e3cf113a024 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:29.914009 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-91063972-bdc6-4c39-8fa6-17d7aa4c80bb tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:29.923476 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-91063972-bdc6-4c39-8fa6-17d7aa4c80bb tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1261 microversion: 2.1 time: 0.208410 Aug 04 10:27:29.924928 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 187/339] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:29 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:30.046629 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bded90e6-d7f4-4177-af1d-225f68e36b16 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:30.047407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bded90e6-d7f4-4177-af1d-225f68e36b16 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:30.054581 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bded90e6-d7f4-4177-af1d-225f68e36b16 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:30.055038 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bded90e6-d7f4-4177-af1d-225f68e36b16 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:30.056457 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bded90e6-d7f4-4177-af1d-225f68e36b16 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:30.056457 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bded90e6-d7f4-4177-af1d-225f68e36b16 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:30.064538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-ad4cec55-dc78-4fbd-89ef-8e3cf113a024 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:30.077288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:30.090271 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ad4cec55-dc78-4fbd-89ef-8e3cf113a024 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1366 microversion: 2.1 time: 0.196498 Aug 04 10:27:30.090864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 153/340] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:29 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:30.230989 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e1128b0b-44d1-426f-8d28-ba8e18e66fa7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:30.231723 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e1128b0b-44d1-426f-8d28-ba8e18e66fa7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:30.232260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bded90e6-d7f4-4177-af1d-225f68e36b16 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:30.245200 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bded90e6-d7f4-4177-af1d-225f68e36b16 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:30.246867 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bded90e6-d7f4-4177-af1d-225f68e36b16 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:30.248783 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bded90e6-d7f4-4177-af1d-225f68e36b16 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1745 microversion: 2.20 time: 0.206524 Aug 04 10:27:30.250920 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e1128b0b-44d1-426f-8d28-ba8e18e66fa7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:30.252723 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e1128b0b-44d1-426f-8d28-ba8e18e66fa7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:30.254979 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e1128b0b-44d1-426f-8d28-ba8e18e66fa7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:30.255948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e1128b0b-44d1-426f-8d28-ba8e18e66fa7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:30.260819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=100 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:30.265345 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 188/341] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:30 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1745 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:30.412604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ecb191d0-b24c-4acf-975e-1cb38c5e2268 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:30.413277 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ecb191d0-b24c-4acf-975e-1cb38c5e2268 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:30.422366 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ecb191d0-b24c-4acf-975e-1cb38c5e2268 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:30.426301 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e1128b0b-44d1-426f-8d28-ba8e18e66fa7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:30.427036 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ecb191d0-b24c-4acf-975e-1cb38c5e2268 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:30.431657 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ecb191d0-b24c-4acf-975e-1cb38c5e2268 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:30.432404 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ecb191d0-b24c-4acf-975e-1cb38c5e2268 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:30.437224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e1128b0b-44d1-426f-8d28-ba8e18e66fa7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1500 microversion: 2.1 time: 0.209157 Aug 04 10:27:30.438330 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 154/342] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:30 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1500 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:30.458959 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-797ca823-fe47-41ef-8097-a7ca4b4f02f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61a96882-76fa-4f03-8830-f2d675fee8d4"}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:30.461913 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-797ca823-fe47-41ef-8097-a7ca4b4f02f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:30.478785 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-797ca823-fe47-41ef-8097-a7ca4b4f02f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:30.482013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-797ca823-fe47-41ef-8097-a7ca4b4f02f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:30.484650 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-797ca823-fe47-41ef-8097-a7ca4b4f02f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:30.485411 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-797ca823-fe47-41ef-8097-a7ca4b4f02f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:30.517859 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-797ca823-fe47-41ef-8097-a7ca4b4f02f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] HTTP exception thrown: Cannot 'attach_volume' instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe while it is in vm_state rescued Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-797ca823-fe47-41ef-8097-a7ca4b4f02f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Request method failure captured: Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: POST /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe/os-volume_attachments HTTP/1.1 Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 74 Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656KqkyTpFin9pC6UUiZnxPdZxrNgZe8aKP2AQVBxtFZQjEPDOz2syoeapzmVECDJuwBzARYqZ1ypET-oDIEGI9g04Puz4edhq-MbhP7Na3of1Dv53H-wKi9amzmFumCavdT1HtBnGsw9vziY0TeEZywE9bNtJErPNB1ve5PDfuHqpw Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 2a801dbffe56474d96c2abea31fd2fdc Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:27:30.520722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:27:30.522236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:27:30.522236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:27:30.522236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 2a801dbffe56474d96c2abea31fd2fdc Aug 04 10:27:30.522236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:27:30.522236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-ServerRescueNegativeTestJSON-532732172-project Aug 04 10:27:30.522236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:27:30.522236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:27:30.522236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: 84b748f30ebc4c5aa2af6ddcd86037cd Aug 04 10:27:30.522236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-ServerRescueNegativeTestJSON-532732172-project Aug 04 10:27:30.522236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Aug 04 10:27:30.522236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {"volumeAttachment": {"volumeId": "61a96882-76fa-4f03-8830-f2d675fee8d4"}} Aug 04 10:27:30.522236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Cannot 'attach_volume' instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe while it is in vm_state rescued Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'server_id': 'ef5108fd-663e-4c6a-bab7-2c706a4b0ebe', 'body': {'volumeAttachment': {'volumeId': '61a96882-76fa-4f03-8830-f2d675fee8d4'}}} Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:27:30.523305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe while it is in vm_state rescued Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:27:30.526339 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:27:30.527810 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:27:30.527810 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:27:30.527810 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe while it is in vm_state rescued Aug 04 10:27:30.527810 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:27:30.529436 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-797ca823-fe47-41ef-8097-a7ca4b4f02f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Returning 409 to user: Cannot 'attach_volume' instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe while it is in vm_state rescued {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:27:30.531239 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-797ca823-fe47-41ef-8097-a7ca4b4f02f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "POST /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077102 Aug 04 10:27:30.532374 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 155/343] 10.222.0.72 () {60 vars in 1323 bytes} [Thu Aug 4 10:27:30 2022] POST /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe/os-volume_attachments => generated 152 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 10:27:30.545407 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-81b1be6a-c34f-4bfd-9ec9-4561861a4299 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:30.545951 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-81b1be6a-c34f-4bfd-9ec9-4561861a4299 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:30.553745 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-81b1be6a-c34f-4bfd-9ec9-4561861a4299 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:30.554197 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-81b1be6a-c34f-4bfd-9ec9-4561861a4299 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:30.555500 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-81b1be6a-c34f-4bfd-9ec9-4561861a4299 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:30.555670 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-81b1be6a-c34f-4bfd-9ec9-4561861a4299 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:30.656410 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ecb191d0-b24c-4acf-975e-1cb38c5e2268 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:30.657016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-81b1be6a-c34f-4bfd-9ec9-4561861a4299 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "POST /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe/action" status: 202 len: 0 microversion: 2.1 time: 0.118821 Aug 04 10:27:30.658307 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 156/344] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:27:30 2022] POST /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:27:30.667768 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ecb191d0-b24c-4acf-975e-1cb38c5e2268 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.259230 Aug 04 10:27:30.680019 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6ac15ff7-1339-466b-a16b-845afe3d3081 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:30.680019 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6ac15ff7-1339-466b-a16b-845afe3d3081 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:30.684606 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 189/345] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:30 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:30.696363 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ac15ff7-1339-466b-a16b-845afe3d3081 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:30.697250 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ac15ff7-1339-466b-a16b-845afe3d3081 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:30.698499 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ac15ff7-1339-466b-a16b-845afe3d3081 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:30.698935 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ac15ff7-1339-466b-a16b-845afe3d3081 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:30.851678 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6ac15ff7-1339-466b-a16b-845afe3d3081 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:30.860393 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6ac15ff7-1339-466b-a16b-845afe3d3081 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1508 microversion: 2.1 time: 0.195035 Aug 04 10:27:30.861174 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 157/346] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:30 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:30.945799 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0d8dc679-cd19-4198-bec6-4a270b052d91 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:30.947230 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0d8dc679-cd19-4198-bec6-4a270b052d91 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:30.957063 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0d8dc679-cd19-4198-bec6-4a270b052d91 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:30.957497 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0d8dc679-cd19-4198-bec6-4a270b052d91 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:30.958807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0d8dc679-cd19-4198-bec6-4a270b052d91 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:30.959282 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0d8dc679-cd19-4198-bec6-4a270b052d91 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:30.982937 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-54b0744e-da99-4353-b59a-75412545ee78 req-0ef0720d-20fa-48f3-82c3-81cad76efd5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323e8a06-ea21-43a6-a575-4973b1616653", "tag": "29a7efd8-df13-46cd-a651-5322ba5514a9"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:31.001503 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-54b0744e-da99-4353-b59a-75412545ee78 req-0ef0720d-20fa-48f3-82c3-81cad76efd5e service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:31.002802 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-54b0744e-da99-4353-b59a-75412545ee78 req-0ef0720d-20fa-48f3-82c3-81cad76efd5e service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:31.017038 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-54b0744e-da99-4353-b59a-75412545ee78 req-0ef0720d-20fa-48f3-82c3-81cad76efd5e service nova] Creating event network-changed:29a7efd8-df13-46cd-a651-5322ba5514a9 for instance 323e8a06-ea21-43a6-a575-4973b1616653 on hv-cinder-82660 Aug 04 10:27:31.022103 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-54b0744e-da99-4353-b59a-75412545ee78 req-0ef0720d-20fa-48f3-82c3-81cad76efd5e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051806 Aug 04 10:27:31.023054 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 158/347] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:31.118069 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d58cc980-7e5d-4055-ae05-ab5ccb628ece tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:31.119177 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-d58cc980-7e5d-4055-ae05-ab5ccb628ece tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:31.121955 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0d8dc679-cd19-4198-bec6-4a270b052d91 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:31.127798 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d58cc980-7e5d-4055-ae05-ab5ccb628ece tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:31.128376 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d58cc980-7e5d-4055-ae05-ab5ccb628ece tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:31.129295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d58cc980-7e5d-4055-ae05-ab5ccb628ece tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:31.129798 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d58cc980-7e5d-4055-ae05-ab5ccb628ece tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:31.131715 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0d8dc679-cd19-4198-bec6-4a270b052d91 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1261 microversion: 2.1 time: 0.190793 Aug 04 10:27:31.132337 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 190/348] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:30 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1261 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:31.273625 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0b410b2c-6f3d-4edd-b0d9-6f60290c44c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:31.274146 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0b410b2c-6f3d-4edd-b0d9-6f60290c44c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:31.276653 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d58cc980-7e5d-4055-ae05-ab5ccb628ece tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:31.281172 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0b410b2c-6f3d-4edd-b0d9-6f60290c44c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:31.281608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0b410b2c-6f3d-4edd-b0d9-6f60290c44c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:31.282369 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0b410b2c-6f3d-4edd-b0d9-6f60290c44c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:31.282826 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0b410b2c-6f3d-4edd-b0d9-6f60290c44c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:31.284282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d58cc980-7e5d-4055-ae05-ab5ccb628ece tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1366 microversion: 2.1 time: 0.174245 Aug 04 10:27:31.285246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 159/349] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:31 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:31.436560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0b410b2c-6f3d-4edd-b0d9-6f60290c44c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:31.444558 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0b410b2c-6f3d-4edd-b0d9-6f60290c44c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:31.446062 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0b410b2c-6f3d-4edd-b0d9-6f60290c44c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:31.447204 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0b410b2c-6f3d-4edd-b0d9-6f60290c44c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1745 microversion: 2.20 time: 0.177666 Aug 04 10:27:31.447761 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 191/350] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:31 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:27:31.695026 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ecddb835-d276-49c3-9950-840a33ca8956 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:31.695712 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ecddb835-d276-49c3-9950-840a33ca8956 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:31.703240 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ecddb835-d276-49c3-9950-840a33ca8956 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:31.703828 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ecddb835-d276-49c3-9950-840a33ca8956 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:31.704916 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ecddb835-d276-49c3-9950-840a33ca8956 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:31.705467 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ecddb835-d276-49c3-9950-840a33ca8956 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:31.881625 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-63703720-f31f-4c89-a979-511d03a6332a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:31.882524 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-63703720-f31f-4c89-a979-511d03a6332a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:31.890135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-63703720-f31f-4c89-a979-511d03a6332a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:31.890723 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-63703720-f31f-4c89-a979-511d03a6332a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:31.891787 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-63703720-f31f-4c89-a979-511d03a6332a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:31.892547 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-63703720-f31f-4c89-a979-511d03a6332a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:31.922562 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-ecddb835-d276-49c3-9950-840a33ca8956 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:31.934723 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ecddb835-d276-49c3-9950-840a33ca8956 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.243860 Aug 04 10:27:31.948302 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 160/351] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:31 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:32.153297 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e617b1bb-cd73-4c71-b669-b47412a2a9e3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:32.154092 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e617b1bb-cd73-4c71-b669-b47412a2a9e3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:32.161389 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e617b1bb-cd73-4c71-b669-b47412a2a9e3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:32.161989 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e617b1bb-cd73-4c71-b669-b47412a2a9e3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:32.162862 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e617b1bb-cd73-4c71-b669-b47412a2a9e3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:32.163393 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e617b1bb-cd73-4c71-b669-b47412a2a9e3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:32.372536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-63703720-f31f-4c89-a979-511d03a6332a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:32.381595 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-63703720-f31f-4c89-a979-511d03a6332a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1508 microversion: 2.1 time: 0.503803 Aug 04 10:27:32.382164 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 192/352] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:31 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1508 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:32.387122 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-abbf6ccd-8aea-41d2-a8f6-6bbd2a0d02d1 req-78eb4857-9b12-40e1-9834-36bc95ec3ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e129c5-a1f4-418e-a7c7-8840c88c20e9", "name": "network-vif-plugged", "status": "completed", "tag": "99b65378-21c4-446f-87b5-bc67e1fde387"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:32.400060 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-abbf6ccd-8aea-41d2-a8f6-6bbd2a0d02d1 req-78eb4857-9b12-40e1-9834-36bc95ec3ff8 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:32.400887 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-abbf6ccd-8aea-41d2-a8f6-6bbd2a0d02d1 req-78eb4857-9b12-40e1-9834-36bc95ec3ff8 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:32.421462 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-abbf6ccd-8aea-41d2-a8f6-6bbd2a0d02d1 req-78eb4857-9b12-40e1-9834-36bc95ec3ff8 service nova] Creating event network-vif-plugged:99b65378-21c4-446f-87b5-bc67e1fde387 for instance 34e129c5-a1f4-418e-a7c7-8840c88c20e9 on hv-cinder-82660 Aug 04 10:27:32.426887 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-abbf6ccd-8aea-41d2-a8f6-6bbd2a0d02d1 req-78eb4857-9b12-40e1-9834-36bc95ec3ff8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043142 Aug 04 10:27:32.428169 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 193/353] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:32.434515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bd11af6c-89db-47a4-917d-7eb6a3f6f2ec tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:32.435558 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bd11af6c-89db-47a4-917d-7eb6a3f6f2ec tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:32.443081 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bd11af6c-89db-47a4-917d-7eb6a3f6f2ec tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:32.443737 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bd11af6c-89db-47a4-917d-7eb6a3f6f2ec tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:32.445709 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bd11af6c-89db-47a4-917d-7eb6a3f6f2ec tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:32.446365 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bd11af6c-89db-47a4-917d-7eb6a3f6f2ec tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:32.642126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e617b1bb-cd73-4c71-b669-b47412a2a9e3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:32.649942 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e617b1bb-cd73-4c71-b669-b47412a2a9e3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1261 microversion: 2.1 time: 0.500953 Aug 04 10:27:32.650932 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 161/354] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:32 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1261 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:32.656072 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7b193b44-65ae-4673-a973-a4da846932e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:32.656855 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7b193b44-65ae-4673-a973-a4da846932e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:32.662969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7b193b44-65ae-4673-a973-a4da846932e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:32.663690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7b193b44-65ae-4673-a973-a4da846932e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:32.664654 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7b193b44-65ae-4673-a973-a4da846932e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:32.665095 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7b193b44-65ae-4673-a973-a4da846932e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:32.758973 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bd11af6c-89db-47a4-917d-7eb6a3f6f2ec tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:32.771604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bd11af6c-89db-47a4-917d-7eb6a3f6f2ec tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1366 microversion: 2.1 time: 0.341993 Aug 04 10:27:32.772327 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 194/355] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:32 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:32.850528 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-7b193b44-65ae-4673-a973-a4da846932e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:32.858991 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-7b193b44-65ae-4673-a973-a4da846932e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:32.860513 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-7b193b44-65ae-4673-a973-a4da846932e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:32.861662 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7b193b44-65ae-4673-a973-a4da846932e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1745 microversion: 2.20 time: 0.209754 Aug 04 10:27:32.862442 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 162/356] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:32 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1745 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:32.958604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3f042d7a-5794-46d5-b44d-667e3328810d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:32.959491 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3f042d7a-5794-46d5-b44d-667e3328810d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:32.966286 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3f042d7a-5794-46d5-b44d-667e3328810d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:32.967235 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3f042d7a-5794-46d5-b44d-667e3328810d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:32.968041 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3f042d7a-5794-46d5-b44d-667e3328810d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:32.971475 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3f042d7a-5794-46d5-b44d-667e3328810d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:33.105555 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3f042d7a-5794-46d5-b44d-667e3328810d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:33.114220 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3f042d7a-5794-46d5-b44d-667e3328810d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.159657 Aug 04 10:27:33.114799 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 195/357] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:32 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:33.402478 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7d559264-8100-486d-98e1-05df56becfb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:33.403088 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7d559264-8100-486d-98e1-05df56becfb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:33.410573 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7d559264-8100-486d-98e1-05df56becfb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:33.411022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7d559264-8100-486d-98e1-05df56becfb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:33.411809 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7d559264-8100-486d-98e1-05df56becfb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:33.412269 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7d559264-8100-486d-98e1-05df56becfb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:33.556208 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-7d559264-8100-486d-98e1-05df56becfb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:33.564399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7d559264-8100-486d-98e1-05df56becfb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1508 microversion: 2.1 time: 0.165458 Aug 04 10:27:33.564981 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 163/358] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:33 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:33.670484 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7482f610-2180-4267-bd7a-4928a3ae4637 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:33.671111 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7482f610-2180-4267-bd7a-4928a3ae4637 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:33.677386 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7482f610-2180-4267-bd7a-4928a3ae4637 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:33.677831 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7482f610-2180-4267-bd7a-4928a3ae4637 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:33.679370 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7482f610-2180-4267-bd7a-4928a3ae4637 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:33.679888 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7482f610-2180-4267-bd7a-4928a3ae4637 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:33.793146 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-cc069d62-0aaf-4e0f-aa5d-a07868cf0465 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:33.794009 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-cc069d62-0aaf-4e0f-aa5d-a07868cf0465 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:33.801035 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cc069d62-0aaf-4e0f-aa5d-a07868cf0465 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:33.801922 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cc069d62-0aaf-4e0f-aa5d-a07868cf0465 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:33.803025 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cc069d62-0aaf-4e0f-aa5d-a07868cf0465 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:33.803783 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cc069d62-0aaf-4e0f-aa5d-a07868cf0465 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:33.823832 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7482f610-2180-4267-bd7a-4928a3ae4637 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:33.836432 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7482f610-2180-4267-bd7a-4928a3ae4637 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1261 microversion: 2.1 time: 0.169580 Aug 04 10:27:33.848814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 196/359] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:33 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:33.887602 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ba9e7cac-b749-429a-a3c4-fd15a7b62f9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:33.889126 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ba9e7cac-b749-429a-a3c4-fd15a7b62f9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:33.899518 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba9e7cac-b749-429a-a3c4-fd15a7b62f9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:33.900611 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba9e7cac-b749-429a-a3c4-fd15a7b62f9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:33.901775 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba9e7cac-b749-429a-a3c4-fd15a7b62f9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:33.902683 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba9e7cac-b749-429a-a3c4-fd15a7b62f9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:34.036180 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-cc069d62-0aaf-4e0f-aa5d-a07868cf0465 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:34.044059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-cc069d62-0aaf-4e0f-aa5d-a07868cf0465 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1366 microversion: 2.1 time: 0.255430 Aug 04 10:27:34.058370 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 164/360] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:33 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:34.104937 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ba9e7cac-b749-429a-a3c4-fd15a7b62f9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:34.115998 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ba9e7cac-b749-429a-a3c4-fd15a7b62f9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:34.117834 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ba9e7cac-b749-429a-a3c4-fd15a7b62f9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:34.119653 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ba9e7cac-b749-429a-a3c4-fd15a7b62f9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1745 microversion: 2.20 time: 0.238883 Aug 04 10:27:34.120247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 197/361] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:33 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1745 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:27:34.141882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a81fee5c-9026-4755-8ab3-68184a57a659 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:34.141882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a81fee5c-9026-4755-8ab3-68184a57a659 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:34.143867 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a81fee5c-9026-4755-8ab3-68184a57a659 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:34.144354 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a81fee5c-9026-4755-8ab3-68184a57a659 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:34.145207 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a81fee5c-9026-4755-8ab3-68184a57a659 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:34.145643 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a81fee5c-9026-4755-8ab3-68184a57a659 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:34.334796 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a81fee5c-9026-4755-8ab3-68184a57a659 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:34.342715 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a81fee5c-9026-4755-8ab3-68184a57a659 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.210248 Aug 04 10:27:34.343271 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 165/362] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:34 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:34.408069 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b3d9b753-666a-40e6-a0d3-9952993607a5 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db7e30ef-8c08-45af-8242-44923b6f04dc", "device": "/dev/sdb"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:34.411254 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b3d9b753-666a-40e6-a0d3-9952993607a5 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:34.417517 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3d9b753-666a-40e6-a0d3-9952993607a5 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:34.417968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3d9b753-666a-40e6-a0d3-9952993607a5 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:34.418739 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3d9b753-666a-40e6-a0d3-9952993607a5 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:34.420409 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3d9b753-666a-40e6-a0d3-9952993607a5 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:34.447477 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-75a7c0cf-1722-4055-8470-f9fa9939bae7 req-51eafa95-10d9-42fc-b4b8-2bac3a1ec6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0396f5e6-1b64-4b0f-9352-28165af5878b", "name": "network-vif-plugged", "status": "completed", "tag": "46e7bd28-a5a1-4c48-aa21-1a4902096c91"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:34.464400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-75a7c0cf-1722-4055-8470-f9fa9939bae7 req-51eafa95-10d9-42fc-b4b8-2bac3a1ec6b3 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:34.465057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-75a7c0cf-1722-4055-8470-f9fa9939bae7 req-51eafa95-10d9-42fc-b4b8-2bac3a1ec6b3 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:34.477245 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-75a7c0cf-1722-4055-8470-f9fa9939bae7 req-51eafa95-10d9-42fc-b4b8-2bac3a1ec6b3 service nova] Creating event network-vif-plugged:46e7bd28-a5a1-4c48-aa21-1a4902096c91 for instance 0396f5e6-1b64-4b0f-9352-28165af5878b on hv-cinder-82660 Aug 04 10:27:34.482189 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-75a7c0cf-1722-4055-8470-f9fa9939bae7 req-51eafa95-10d9-42fc-b4b8-2bac3a1ec6b3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040785 Aug 04 10:27:34.483273 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 166/363] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:27:34.585591 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-58a5a06c-3921-4e06-9c0e-da05d6217170 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:34.586287 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-58a5a06c-3921-4e06-9c0e-da05d6217170 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:34.588570 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:34.594367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-58a5a06c-3921-4e06-9c0e-da05d6217170 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:34.594814 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-58a5a06c-3921-4e06-9c0e-da05d6217170 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:34.595583 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-58a5a06c-3921-4e06-9c0e-da05d6217170 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:34.596072 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-58a5a06c-3921-4e06-9c0e-da05d6217170 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:34.736269 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-58a5a06c-3921-4e06-9c0e-da05d6217170 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:34.743818 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-58a5a06c-3921-4e06-9c0e-da05d6217170 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1508 microversion: 2.1 time: 0.162397 Aug 04 10:27:34.744492 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 167/364] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:34 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:34.858490 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9a2ee1ac-e435-43a6-aa9a-abca6bcea50e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:34.859097 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9a2ee1ac-e435-43a6-aa9a-abca6bcea50e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:34.865033 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a2ee1ac-e435-43a6-aa9a-abca6bcea50e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:34.865476 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a2ee1ac-e435-43a6-aa9a-abca6bcea50e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:34.866230 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a2ee1ac-e435-43a6-aa9a-abca6bcea50e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:34.866663 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a2ee1ac-e435-43a6-aa9a-abca6bcea50e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:35.000482 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9a2ee1ac-e435-43a6-aa9a-abca6bcea50e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:35.008875 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9a2ee1ac-e435-43a6-aa9a-abca6bcea50e tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1261 microversion: 2.1 time: 0.154219 Aug 04 10:27:35.009446 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 168/365] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:34 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:35.065578 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-bdaeafa3-4e33-4bcb-a96a-29c68983b2ad tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:35.066219 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-bdaeafa3-4e33-4bcb-a96a-29c68983b2ad tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:35.072626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bdaeafa3-4e33-4bcb-a96a-29c68983b2ad tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:35.073074 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bdaeafa3-4e33-4bcb-a96a-29c68983b2ad tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:35.073933 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bdaeafa3-4e33-4bcb-a96a-29c68983b2ad tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:35.074405 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bdaeafa3-4e33-4bcb-a96a-29c68983b2ad tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:35.220142 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bdaeafa3-4e33-4bcb-a96a-29c68983b2ad tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:35.227636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-bdaeafa3-4e33-4bcb-a96a-29c68983b2ad tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1366 microversion: 2.1 time: 0.166053 Aug 04 10:27:35.228342 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 169/366] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:35 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:35.233020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-165af745-38c3-4a45-82b9-66bad83d72d5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:35.233614 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-165af745-38c3-4a45-82b9-66bad83d72d5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:35.239526 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-165af745-38c3-4a45-82b9-66bad83d72d5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:35.239997 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-165af745-38c3-4a45-82b9-66bad83d72d5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:35.240761 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-165af745-38c3-4a45-82b9-66bad83d72d5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:35.241196 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-165af745-38c3-4a45-82b9-66bad83d72d5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:35.265946 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:35.377357 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-165af745-38c3-4a45-82b9-66bad83d72d5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:35.385386 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-165af745-38c3-4a45-82b9-66bad83d72d5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:35.386920 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-165af745-38c3-4a45-82b9-66bad83d72d5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:35.388097 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-165af745-38c3-4a45-82b9-66bad83d72d5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1745 microversion: 2.20 time: 0.158822 Aug 04 10:27:35.389284 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 170/367] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:35 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:35.393604 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-50b0b026-a254-4c84-8f88-66c145e5f383 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:35.394870 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-50b0b026-a254-4c84-8f88-66c145e5f383 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:35.400942 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-50b0b026-a254-4c84-8f88-66c145e5f383 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:35.401386 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-50b0b026-a254-4c84-8f88-66c145e5f383 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:35.402146 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-50b0b026-a254-4c84-8f88-66c145e5f383 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:35.402574 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-50b0b026-a254-4c84-8f88-66c145e5f383 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:35.420924 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:35.472674 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=8 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:35.541575 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-50b0b026-a254-4c84-8f88-66c145e5f383 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:35.549879 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-50b0b026-a254-4c84-8f88-66c145e5f383 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1722 microversion: 2.1 time: 0.159647 Aug 04 10:27:35.550438 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 171/368] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:35 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:35.764720 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7f5fc62b-c291-4a79-9687-18905331ffcb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:35.765371 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7f5fc62b-c291-4a79-9687-18905331ffcb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:35.771760 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7f5fc62b-c291-4a79-9687-18905331ffcb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:35.772235 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7f5fc62b-c291-4a79-9687-18905331ffcb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:35.773021 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7f5fc62b-c291-4a79-9687-18905331ffcb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:35.773452 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7f5fc62b-c291-4a79-9687-18905331ffcb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:35.911945 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-7f5fc62b-c291-4a79-9687-18905331ffcb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:35.920774 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7f5fc62b-c291-4a79-9687-18905331ffcb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1514 microversion: 2.1 time: 0.159984 Aug 04 10:27:35.921346 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 172/369] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:35 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:36.032539 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7d801d27-a38a-4f2d-bbc1-0108982de5cc tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:36.033151 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7d801d27-a38a-4f2d-bbc1-0108982de5cc tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:36.039154 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7d801d27-a38a-4f2d-bbc1-0108982de5cc tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:36.039604 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7d801d27-a38a-4f2d-bbc1-0108982de5cc tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:36.040615 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7d801d27-a38a-4f2d-bbc1-0108982de5cc tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:36.041262 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7d801d27-a38a-4f2d-bbc1-0108982de5cc tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:36.198100 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-7d801d27-a38a-4f2d-bbc1-0108982de5cc tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:36.206850 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7d801d27-a38a-4f2d-bbc1-0108982de5cc tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1261 microversion: 2.1 time: 0.178597 Aug 04 10:27:36.208019 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 173/370] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:36 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:36.257575 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0d7d4919-903c-4d61-9c9c-63edcdd2d246 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:36.258300 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0d7d4919-903c-4d61-9c9c-63edcdd2d246 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:36.272601 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0d7d4919-903c-4d61-9c9c-63edcdd2d246 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:36.273149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0d7d4919-903c-4d61-9c9c-63edcdd2d246 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:36.274009 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0d7d4919-903c-4d61-9c9c-63edcdd2d246 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:36.274508 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0d7d4919-903c-4d61-9c9c-63edcdd2d246 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:36.419991 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0d7d4919-903c-4d61-9c9c-63edcdd2d246 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:36.436428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0d7d4919-903c-4d61-9c9c-63edcdd2d246 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1366 microversion: 2.1 time: 0.182859 Aug 04 10:27:36.437127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 174/371] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:36 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:36.442010 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8f66cf53-6c39-4bc8-a2dc-4ab8bdde67c7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:36.442707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8f66cf53-6c39-4bc8-a2dc-4ab8bdde67c7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:36.449092 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8f66cf53-6c39-4bc8-a2dc-4ab8bdde67c7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:36.449620 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8f66cf53-6c39-4bc8-a2dc-4ab8bdde67c7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:36.450467 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8f66cf53-6c39-4bc8-a2dc-4ab8bdde67c7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:36.451464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8f66cf53-6c39-4bc8-a2dc-4ab8bdde67c7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:36.530976 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b3d9b753-666a-40e6-a0d3-9952993607a5 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "POST /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.127079 Aug 04 10:27:36.531756 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 198/372] 10.222.0.72 () {60 vars in 1323 bytes} [Thu Aug 4 10:27:34 2022] POST /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b/os-volume_attachments => generated 194 bytes in 2129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:36.549148 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-7a28f673-5c65-443b-8623-64499e0592fc req-03cefe1b-14ed-4aa7-9317-d09ba2b4421b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323e8a06-ea21-43a6-a575-4973b1616653", "name": "network-vif-plugged", "status": "completed", "tag": "29a7efd8-df13-46cd-a651-5322ba5514a9"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:36.575333 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-7a28f673-5c65-443b-8623-64499e0592fc req-03cefe1b-14ed-4aa7-9317-d09ba2b4421b service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:36.578008 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-7a28f673-5c65-443b-8623-64499e0592fc req-03cefe1b-14ed-4aa7-9317-d09ba2b4421b service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:36.595337 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-7a28f673-5c65-443b-8623-64499e0592fc req-03cefe1b-14ed-4aa7-9317-d09ba2b4421b service nova] Creating event network-vif-plugged:29a7efd8-df13-46cd-a651-5322ba5514a9 for instance 323e8a06-ea21-43a6-a575-4973b1616653 on hv-cinder-82660 Aug 04 10:27:36.602047 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8f66cf53-6c39-4bc8-a2dc-4ab8bdde67c7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:36.604242 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-7a28f673-5c65-443b-8623-64499e0592fc req-03cefe1b-14ed-4aa7-9317-d09ba2b4421b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063426 Aug 04 10:27:36.605411 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 199/373] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:36.622293 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-94f72d87-99cd-4945-8851-9fe9b5881ed6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:36.624266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-94f72d87-99cd-4945-8851-9fe9b5881ed6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:36.632355 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-94f72d87-99cd-4945-8851-9fe9b5881ed6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:36.632642 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8f66cf53-6c39-4bc8-a2dc-4ab8bdde67c7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:36.634101 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-94f72d87-99cd-4945-8851-9fe9b5881ed6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:36.635313 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-94f72d87-99cd-4945-8851-9fe9b5881ed6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:36.636081 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-94f72d87-99cd-4945-8851-9fe9b5881ed6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:36.636257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8f66cf53-6c39-4bc8-a2dc-4ab8bdde67c7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:36.640342 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8f66cf53-6c39-4bc8-a2dc-4ab8bdde67c7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.201796 Aug 04 10:27:36.640942 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 175/374] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:36 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:36.784423 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-94f72d87-99cd-4945-8851-9fe9b5881ed6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:36.792629 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-94f72d87-99cd-4945-8851-9fe9b5881ed6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1699 microversion: 2.1 time: 0.175153 Aug 04 10:27:36.793206 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 200/375] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:36 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1699 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:36.813877 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0cf5f99b-fbe1-4fb9-8405-9c6012436066 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:36.820516 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0cf5f99b-fbe1-4fb9-8405-9c6012436066 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:36.820963 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0cf5f99b-fbe1-4fb9-8405-9c6012436066 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:36.842879 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0cf5f99b-fbe1-4fb9-8405-9c6012436066 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Going to try to start instance {{(pid=117667) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 10:27:36.887754 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0cf5f99b-fbe1-4fb9-8405-9c6012436066 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "POST /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/action" status: 202 len: 0 microversion: 2.1 time: 0.077517 Aug 04 10:27:36.888334 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 176/376] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:27:36 2022] POST /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 10:27:36.916240 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1cc11650-44c5-4122-ae6e-b4ca18c223c3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:36.916852 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1cc11650-44c5-4122-ae6e-b4ca18c223c3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:36.936291 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1cc11650-44c5-4122-ae6e-b4ca18c223c3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:36.937930 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1cc11650-44c5-4122-ae6e-b4ca18c223c3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:36.939724 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1cc11650-44c5-4122-ae6e-b4ca18c223c3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:36.940776 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1cc11650-44c5-4122-ae6e-b4ca18c223c3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:37.112071 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1cc11650-44c5-4122-ae6e-b4ca18c223c3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:37.128927 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1cc11650-44c5-4122-ae6e-b4ca18c223c3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1708 microversion: 2.1 time: 0.218744 Aug 04 10:27:37.129863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 201/377] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:36 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1708 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:37.228682 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8704680f-ef44-4623-8763-6bb09b350b5b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:37.229274 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8704680f-ef44-4623-8763-6bb09b350b5b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:37.235424 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8704680f-ef44-4623-8763-6bb09b350b5b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:37.235971 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8704680f-ef44-4623-8763-6bb09b350b5b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:37.236735 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8704680f-ef44-4623-8763-6bb09b350b5b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:37.237166 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8704680f-ef44-4623-8763-6bb09b350b5b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:37.320694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b3f01e56-132e-43c9-b8e0-cf831af65345 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Action: 'create', calling method: .version_select at 0x7fbaa780a1f0>, body: {"keypair": {"name": "tempest-keypair-1753184354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBvuqJ18hxKYyv2tT5QXrZCG7wZKY6ttGmGmbhPL6r/r8hdxYJgNn3uQ0fsd3TQYMHBNzRDPyfJBxMXAn1OilkSReI11WyzQ1oWZGd6Ccw+Hp2nWyRRdMkUvSFhc64EDw=="}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:37.350287 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-b3f01e56-132e-43c9-b8e0-cf831af65345 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Getting quotas for project 2a801dbffe56474d96c2abea31fd2fdc. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:27:37.354397 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-b3f01e56-132e-43c9-b8e0-cf831af65345 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Getting quotas for user 84b748f30ebc4c5aa2af6ddcd86037cd and project 2a801dbffe56474d96c2abea31fd2fdc. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:27:37.381756 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b3f01e56-132e-43c9-b8e0-cf831af65345 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064746 Aug 04 10:27:37.382200 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 202/378] 10.222.0.72 () {60 vars in 1159 bytes} [Thu Aug 4 10:27:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:37.385562 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8704680f-ef44-4623-8763-6bb09b350b5b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:37.394021 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8704680f-ef44-4623-8763-6bb09b350b5b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1261 microversion: 2.1 time: 0.169815 Aug 04 10:27:37.394586 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 177/379] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:37 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:37.457385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7d9bf9e3-b8ed-4884-a852-4b2144e2d4d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:37.458000 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7d9bf9e3-b8ed-4884-a852-4b2144e2d4d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:37.465325 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d9bf9e3-b8ed-4884-a852-4b2144e2d4d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:37.465779 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d9bf9e3-b8ed-4884-a852-4b2144e2d4d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:37.467208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d9bf9e3-b8ed-4884-a852-4b2144e2d4d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:37.467664 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d9bf9e3-b8ed-4884-a852-4b2144e2d4d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:37.619640 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7d9bf9e3-b8ed-4884-a852-4b2144e2d4d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:37.628202 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7d9bf9e3-b8ed-4884-a852-4b2144e2d4d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1366 microversion: 2.1 time: 0.174653 Aug 04 10:27:37.628794 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 203/380] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:37 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:37.666812 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c9bd8d0f-36d1-4f26-ba43-fc0c0771734c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:37.667515 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c9bd8d0f-36d1-4f26-ba43-fc0c0771734c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:37.675089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c9bd8d0f-36d1-4f26-ba43-fc0c0771734c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:37.675615 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c9bd8d0f-36d1-4f26-ba43-fc0c0771734c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:37.676624 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c9bd8d0f-36d1-4f26-ba43-fc0c0771734c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:37.677062 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c9bd8d0f-36d1-4f26-ba43-fc0c0771734c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:37.856268 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c9bd8d0f-36d1-4f26-ba43-fc0c0771734c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:37.865311 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c9bd8d0f-36d1-4f26-ba43-fc0c0771734c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:37.866970 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c9bd8d0f-36d1-4f26-ba43-fc0c0771734c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:37.868581 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c9bd8d0f-36d1-4f26-ba43-fc0c0771734c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.205661 Aug 04 10:27:37.869211 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 178/381] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:37 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:38.151736 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f745da17-4947-48ad-8181-8329eee0d30b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:38.152516 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f745da17-4947-48ad-8181-8329eee0d30b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:38.159522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f745da17-4947-48ad-8181-8329eee0d30b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:38.159981 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f745da17-4947-48ad-8181-8329eee0d30b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:38.160776 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f745da17-4947-48ad-8181-8329eee0d30b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:38.161208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f745da17-4947-48ad-8181-8329eee0d30b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:38.309521 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f745da17-4947-48ad-8181-8329eee0d30b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:38.318024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f745da17-4947-48ad-8181-8329eee0d30b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1708 microversion: 2.1 time: 0.170990 Aug 04 10:27:38.318609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 204/382] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:38 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1708 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:38.414890 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-da1a853b-b1e4-44da-b37a-79cd009dd096 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:38.415409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-da1a853b-b1e4-44da-b37a-79cd009dd096 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:38.422050 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-da1a853b-b1e4-44da-b37a-79cd009dd096 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:38.422492 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-da1a853b-b1e4-44da-b37a-79cd009dd096 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:38.423519 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-da1a853b-b1e4-44da-b37a-79cd009dd096 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:38.423950 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-da1a853b-b1e4-44da-b37a-79cd009dd096 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:38.557131 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-da1a853b-b1e4-44da-b37a-79cd009dd096 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:38.564851 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-da1a853b-b1e4-44da-b37a-79cd009dd096 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1445 microversion: 2.1 time: 0.153999 Aug 04 10:27:38.565618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 179/383] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:38 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:38.587728 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c4d93bf7-77f2-4243-bf12-c7be1316039c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:38.588725 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c4d93bf7-77f2-4243-bf12-c7be1316039c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:38.598761 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c4d93bf7-77f2-4243-bf12-c7be1316039c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:38.599323 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c4d93bf7-77f2-4243-bf12-c7be1316039c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:38.600381 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c4d93bf7-77f2-4243-bf12-c7be1316039c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:38.600882 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c4d93bf7-77f2-4243-bf12-c7be1316039c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:38.650798 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a30c67c0-d867-412d-8949-332f4927d929 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:38.651877 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a30c67c0-d867-412d-8949-332f4927d929 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:38.660898 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a30c67c0-d867-412d-8949-332f4927d929 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:38.661770 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a30c67c0-d867-412d-8949-332f4927d929 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:38.662978 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a30c67c0-d867-412d-8949-332f4927d929 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:38.663709 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a30c67c0-d867-412d-8949-332f4927d929 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:38.811886 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c4d93bf7-77f2-4243-bf12-c7be1316039c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:38.828385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c4d93bf7-77f2-4243-bf12-c7be1316039c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1445 microversion: 2.1 time: 0.244976 Aug 04 10:27:38.829586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 205/384] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:38 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1445 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:38.900623 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-27e353c5-df20-43a8-927c-34055357f623 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:38.901473 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-27e353c5-df20-43a8-927c-34055357f623 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:38.911107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-27e353c5-df20-43a8-927c-34055357f623 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:38.911570 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-27e353c5-df20-43a8-927c-34055357f623 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:38.912385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-27e353c5-df20-43a8-927c-34055357f623 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:38.912822 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-27e353c5-df20-43a8-927c-34055357f623 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:38.923625 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a30c67c0-d867-412d-8949-332f4927d929 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:38.932221 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:38.932762 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a30c67c0-d867-412d-8949-332f4927d929 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1366 microversion: 2.1 time: 0.287455 Aug 04 10:27:38.933977 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 180/385] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:38 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:39.114742 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-27e353c5-df20-43a8-927c-34055357f623 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:39.125533 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-27e353c5-df20-43a8-927c-34055357f623 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:39.127498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-27e353c5-df20-43a8-927c-34055357f623 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:39.129053 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-27e353c5-df20-43a8-927c-34055357f623 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.241294 Aug 04 10:27:39.129786 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 206/386] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:38 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:27:39.279020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-32271088", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a595c269-03f2-49b6-9865-e02addf09c72"}], "security_groups": [{"name": "tempest-securitygroup--592783938"}], "key_name": "tempest-keypair-1753184354", "user_data": "}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:39.339349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d2028f1f-be34-4d99-9c1f-ce5af791eb43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:39.340165 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d2028f1f-be34-4d99-9c1f-ce5af791eb43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:39.346179 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2028f1f-be34-4d99-9c1f-ce5af791eb43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:39.346700 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2028f1f-be34-4d99-9c1f-ce5af791eb43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:39.347636 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2028f1f-be34-4d99-9c1f-ce5af791eb43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:39.348253 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2028f1f-be34-4d99-9c1f-ce5af791eb43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:39.580075 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d2028f1f-be34-4d99-9c1f-ce5af791eb43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:39.588006 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d2028f1f-be34-4d99-9c1f-ce5af791eb43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1708 microversion: 2.1 time: 0.252768 Aug 04 10:27:39.588620 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 207/387] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:39 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1708 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:39.960395 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-56458fc0-5b6b-4a63-ab8b-a639cf9ebb65 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:39.960395 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-56458fc0-5b6b-4a63-ab8b-a639cf9ebb65 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:39.972143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56458fc0-5b6b-4a63-ab8b-a639cf9ebb65 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:39.972608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56458fc0-5b6b-4a63-ab8b-a639cf9ebb65 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:39.973403 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56458fc0-5b6b-4a63-ab8b-a639cf9ebb65 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:39.974007 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56458fc0-5b6b-4a63-ab8b-a639cf9ebb65 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:40.187859 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-56458fc0-5b6b-4a63-ab8b-a639cf9ebb65 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:40.196985 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-56458fc0-5b6b-4a63-ab8b-a639cf9ebb65 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1366 microversion: 2.1 time: 0.247006 Aug 04 10:27:40.197574 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 208/388] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:39 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:40.209822 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2c741ceb-6cfe-470a-96cd-2a45463109f1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:40.211775 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2c741ceb-6cfe-470a-96cd-2a45463109f1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:40.219062 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2c741ceb-6cfe-470a-96cd-2a45463109f1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:40.219583 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2c741ceb-6cfe-470a-96cd-2a45463109f1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:40.220448 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2c741ceb-6cfe-470a-96cd-2a45463109f1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:40.221051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2c741ceb-6cfe-470a-96cd-2a45463109f1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:40.437553 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2c741ceb-6cfe-470a-96cd-2a45463109f1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:40.445805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2c741ceb-6cfe-470a-96cd-2a45463109f1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:40.447388 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2c741ceb-6cfe-470a-96cd-2a45463109f1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:40.448643 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2c741ceb-6cfe-470a-96cd-2a45463109f1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.243265 Aug 04 10:27:40.449317 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 209/389] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:40 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:40.610044 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ece0d30e-a020-4836-99fa-b1f441b3cc54 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:40.613281 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ece0d30e-a020-4836-99fa-b1f441b3cc54 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:40.619767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ece0d30e-a020-4836-99fa-b1f441b3cc54 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:40.620261 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ece0d30e-a020-4836-99fa-b1f441b3cc54 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:40.621048 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ece0d30e-a020-4836-99fa-b1f441b3cc54 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:40.621482 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ece0d30e-a020-4836-99fa-b1f441b3cc54 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:40.854640 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ece0d30e-a020-4836-99fa-b1f441b3cc54 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:40.863109 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ece0d30e-a020-4836-99fa-b1f441b3cc54 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1708 microversion: 2.1 time: 0.257153 Aug 04 10:27:40.863601 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 210/390] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:40 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1708 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:41.218797 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-13a4a076-82d0-4a84-922b-3b8ba433dee6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:41.219431 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-13a4a076-82d0-4a84-922b-3b8ba433dee6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:41.225891 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13a4a076-82d0-4a84-922b-3b8ba433dee6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:41.226347 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13a4a076-82d0-4a84-922b-3b8ba433dee6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:41.227117 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13a4a076-82d0-4a84-922b-3b8ba433dee6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:41.227612 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13a4a076-82d0-4a84-922b-3b8ba433dee6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:41.396569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-13a4a076-82d0-4a84-922b-3b8ba433dee6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:41.404928 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-13a4a076-82d0-4a84-922b-3b8ba433dee6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1556 microversion: 2.1 time: 0.190018 Aug 04 10:27:41.405671 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 211/391] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:41 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1556 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:41.410476 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-865a40c7-f107-44b3-8494-134f8e227c8f req-eb5a4175-642f-41d6-a8a2-bf6c04dd95c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e129c5-a1f4-418e-a7c7-8840c88c20e9", "tag": "99b65378-21c4-446f-87b5-bc67e1fde387"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:41.420141 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-865a40c7-f107-44b3-8494-134f8e227c8f req-eb5a4175-642f-41d6-a8a2-bf6c04dd95c0 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:41.420590 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-865a40c7-f107-44b3-8494-134f8e227c8f req-eb5a4175-642f-41d6-a8a2-bf6c04dd95c0 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:41.431765 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-865a40c7-f107-44b3-8494-134f8e227c8f req-eb5a4175-642f-41d6-a8a2-bf6c04dd95c0 service nova] Creating event network-changed:99b65378-21c4-446f-87b5-bc67e1fde387 for instance 34e129c5-a1f4-418e-a7c7-8840c88c20e9 on hv-cinder-82660 Aug 04 10:27:41.437252 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-865a40c7-f107-44b3-8494-134f8e227c8f req-eb5a4175-642f-41d6-a8a2-bf6c04dd95c0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030437 Aug 04 10:27:41.437833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 212/392] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:41.442836 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-039d2ecd-715f-4e0d-a22e-5e88f6edb824 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:41.443395 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-039d2ecd-715f-4e0d-a22e-5e88f6edb824 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:41.449506 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-039d2ecd-715f-4e0d-a22e-5e88f6edb824 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:41.449947 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-039d2ecd-715f-4e0d-a22e-5e88f6edb824 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:41.450766 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-039d2ecd-715f-4e0d-a22e-5e88f6edb824 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:41.451690 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-039d2ecd-715f-4e0d-a22e-5e88f6edb824 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:41.528145 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-039d2ecd-715f-4e0d-a22e-5e88f6edb824 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089050 Aug 04 10:27:41.528740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 213/393] 10.222.0.72 () {58 vars in 1275 bytes} [Thu Aug 4 10:27:41 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:41.539902 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c4d4e93e-9715-4371-9410-04cd2f0919e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:41.540776 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c4d4e93e-9715-4371-9410-04cd2f0919e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:41.548569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c4d4e93e-9715-4371-9410-04cd2f0919e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:41.549084 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c4d4e93e-9715-4371-9410-04cd2f0919e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:41.549874 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c4d4e93e-9715-4371-9410-04cd2f0919e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:41.550301 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c4d4e93e-9715-4371-9410-04cd2f0919e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:41.834207 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c4d4e93e-9715-4371-9410-04cd2f0919e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:41.860136 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c4d4e93e-9715-4371-9410-04cd2f0919e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:41.866967 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c4d4e93e-9715-4371-9410-04cd2f0919e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:41.870065 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c4d4e93e-9715-4371-9410-04cd2f0919e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.340281 Aug 04 10:27:41.871068 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 214/394] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:41 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:41.889949 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e68dd008-845e-4691-ac8a-4dddb780e123 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:41.890621 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e68dd008-845e-4691-ac8a-4dddb780e123 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:41.897875 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e68dd008-845e-4691-ac8a-4dddb780e123 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:41.897875 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e68dd008-845e-4691-ac8a-4dddb780e123 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:41.898661 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e68dd008-845e-4691-ac8a-4dddb780e123 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:41.899006 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e68dd008-845e-4691-ac8a-4dddb780e123 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:42.141619 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.network.neutron [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] validate_networks() for [('a595c269-03f2-49b6-9865-e02addf09c72', None, None, None, None, None)] {{(pid=117667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:27:42.293113 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e68dd008-845e-4691-ac8a-4dddb780e123 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:42.305872 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e68dd008-845e-4691-ac8a-4dddb780e123 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1712 microversion: 2.1 time: 0.424754 Aug 04 10:27:42.306558 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 215/395] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:41 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1712 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:42.894707 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-90fc01cf-7b3d-4707-90d7-a8087dcd3db2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:42.895726 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-90fc01cf-7b3d-4707-90d7-a8087dcd3db2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:42.901946 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90fc01cf-7b3d-4707-90d7-a8087dcd3db2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:42.902899 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90fc01cf-7b3d-4707-90d7-a8087dcd3db2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:42.904739 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90fc01cf-7b3d-4707-90d7-a8087dcd3db2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:42.905462 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90fc01cf-7b3d-4707-90d7-a8087dcd3db2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:43.098878 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Flavor limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:27:43.099826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Image limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:27:43.101706 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Flavor pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:27:43.103174 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Image pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:27:43.104761 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:27:43.150768 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:43.152785 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:43.154517 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:43.156811 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:43.219192 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Getting quotas for project 2a801dbffe56474d96c2abea31fd2fdc. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:27:43.230567 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Getting quotas for user 84b748f30ebc4c5aa2af6ddcd86037cd and project 2a801dbffe56474d96c2abea31fd2fdc. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:27:43.258448 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Going to run 1 instances... {{(pid=117667) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:27:43.264185 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:27:43.273231 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-90fc01cf-7b3d-4707-90d7-a8087dcd3db2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:43.285693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-90fc01cf-7b3d-4707-90d7-a8087dcd3db2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:43.288540 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-90fc01cf-7b3d-4707-90d7-a8087dcd3db2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:43.293176 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-90fc01cf-7b3d-4707-90d7-a8087dcd3db2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.402553 Aug 04 10:27:43.310040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 216/396] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:42 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:27:43.375463 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-dc62c0af-9053-48f5-bada-c9e28e79290f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.100967 Aug 04 10:27:43.378329 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 181/397] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:27:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 4105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:27:43.388986 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f664c907-79c9-4e98-879f-13010914995a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:43.389843 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f664c907-79c9-4e98-879f-13010914995a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:43.519990 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f664c907-79c9-4e98-879f-13010914995a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:43.532646 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f664c907-79c9-4e98-879f-13010914995a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1244 microversion: 2.1 time: 0.147221 Aug 04 10:27:43.534018 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 217/398] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:43 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1244 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:43.537314 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-fd8b137d-11d3-44ba-9323-0ef299c6de08 req-e66a5e21-65a2-4a07-95bf-7d0a56e7a0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323e8a06-ea21-43a6-a575-4973b1616653", "tag": "29a7efd8-df13-46cd-a651-5322ba5514a9"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:43.553177 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-fd8b137d-11d3-44ba-9323-0ef299c6de08 req-e66a5e21-65a2-4a07-95bf-7d0a56e7a0b9 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:43.553880 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-fd8b137d-11d3-44ba-9323-0ef299c6de08 req-e66a5e21-65a2-4a07-95bf-7d0a56e7a0b9 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:43.567184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-fd8b137d-11d3-44ba-9323-0ef299c6de08 req-e66a5e21-65a2-4a07-95bf-7d0a56e7a0b9 service nova] Creating event network-changed:29a7efd8-df13-46cd-a651-5322ba5514a9 for instance 323e8a06-ea21-43a6-a575-4973b1616653 on hv-cinder-82660 Aug 04 10:27:43.572448 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-fd8b137d-11d3-44ba-9323-0ef299c6de08 req-e66a5e21-65a2-4a07-95bf-7d0a56e7a0b9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039891 Aug 04 10:27:43.573621 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 182/399] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:27:44.323140 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ab856ab1-6e20-4bac-b274-fdc98499e787 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:44.324085 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ab856ab1-6e20-4bac-b274-fdc98499e787 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:44.343506 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab856ab1-6e20-4bac-b274-fdc98499e787 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:44.344960 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab856ab1-6e20-4bac-b274-fdc98499e787 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:44.346870 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab856ab1-6e20-4bac-b274-fdc98499e787 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:44.348755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab856ab1-6e20-4bac-b274-fdc98499e787 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:44.555887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-bae0aa78-fcae-479a-b51b-d9a027de916a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:44.557964 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-bae0aa78-fcae-479a-b51b-d9a027de916a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:44.573182 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bae0aa78-fcae-479a-b51b-d9a027de916a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:44.574110 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bae0aa78-fcae-479a-b51b-d9a027de916a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:44.576323 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bae0aa78-fcae-479a-b51b-d9a027de916a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:44.577694 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bae0aa78-fcae-479a-b51b-d9a027de916a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:44.596404 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ab856ab1-6e20-4bac-b274-fdc98499e787 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:44.606630 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ab856ab1-6e20-4bac-b274-fdc98499e787 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:44.609081 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ab856ab1-6e20-4bac-b274-fdc98499e787 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:44.612124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ab856ab1-6e20-4bac-b274-fdc98499e787 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.293242 Aug 04 10:27:44.613058 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 218/400] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:44 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:44.696764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bae0aa78-fcae-479a-b51b-d9a027de916a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:44.709216 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-bae0aa78-fcae-479a-b51b-d9a027de916a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1296 microversion: 2.1 time: 0.159148 Aug 04 10:27:44.711535 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 183/401] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:44 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1296 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:45.637629 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3b180cff-3294-4706-b4d2-8b03b5e5fa70 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:45.639573 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3b180cff-3294-4706-b4d2-8b03b5e5fa70 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:45.643288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:45.659489 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3b180cff-3294-4706-b4d2-8b03b5e5fa70 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:45.659690 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3b180cff-3294-4706-b4d2-8b03b5e5fa70 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:45.660772 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3b180cff-3294-4706-b4d2-8b03b5e5fa70 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:45.661321 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3b180cff-3294-4706-b4d2-8b03b5e5fa70 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:45.742270 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-575810a3-098e-4409-99ff-b3333d557c8d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:45.742897 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-575810a3-098e-4409-99ff-b3333d557c8d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:45.756520 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-575810a3-098e-4409-99ff-b3333d557c8d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:45.757085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-575810a3-098e-4409-99ff-b3333d557c8d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:45.757918 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-575810a3-098e-4409-99ff-b3333d557c8d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:45.758357 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-575810a3-098e-4409-99ff-b3333d557c8d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:45.844543 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-575810a3-098e-4409-99ff-b3333d557c8d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:45.855323 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-575810a3-098e-4409-99ff-b3333d557c8d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1304 microversion: 2.1 time: 0.126988 Aug 04 10:27:45.860770 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3b180cff-3294-4706-b4d2-8b03b5e5fa70 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:45.869502 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 184/402] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:45 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:45.873453 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3b180cff-3294-4706-b4d2-8b03b5e5fa70 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:45.876675 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3b180cff-3294-4706-b4d2-8b03b5e5fa70 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:45.877891 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3b180cff-3294-4706-b4d2-8b03b5e5fa70 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.244564 Aug 04 10:27:45.878466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 219/403] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:45 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:46.877515 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-fff4b2b0-b357-474f-9b4c-6686f6ce71ef tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:46.878364 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-fff4b2b0-b357-474f-9b4c-6686f6ce71ef tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:46.888417 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fff4b2b0-b357-474f-9b4c-6686f6ce71ef tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:46.888982 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fff4b2b0-b357-474f-9b4c-6686f6ce71ef tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:46.889860 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fff4b2b0-b357-474f-9b4c-6686f6ce71ef tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:46.890585 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fff4b2b0-b357-474f-9b4c-6686f6ce71ef tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:46.906329 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-04237fe3-4e62-40cb-9515-0b682f8e623b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:46.906941 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-04237fe3-4e62-40cb-9515-0b682f8e623b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:46.925600 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04237fe3-4e62-40cb-9515-0b682f8e623b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:46.926262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04237fe3-4e62-40cb-9515-0b682f8e623b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:46.927243 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04237fe3-4e62-40cb-9515-0b682f8e623b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:46.927823 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04237fe3-4e62-40cb-9515-0b682f8e623b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:46.993010 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-fff4b2b0-b357-474f-9b4c-6686f6ce71ef tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:47.001996 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-fff4b2b0-b357-474f-9b4c-6686f6ce71ef tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1304 microversion: 2.1 time: 0.128800 Aug 04 10:27:47.003290 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 185/404] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:46 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:47.099238 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-04237fe3-4e62-40cb-9515-0b682f8e623b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:47.110247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-04237fe3-4e62-40cb-9515-0b682f8e623b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:47.112068 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-04237fe3-4e62-40cb-9515-0b682f8e623b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:47.113446 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-04237fe3-4e62-40cb-9515-0b682f8e623b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.214571 Aug 04 10:27:47.114003 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 220/405] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:46 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:48.023043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-cd2396f0-6b20-4438-a5a2-33d169b9bc35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:48.023907 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-cd2396f0-6b20-4438-a5a2-33d169b9bc35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:48.036422 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cd2396f0-6b20-4438-a5a2-33d169b9bc35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:48.037217 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cd2396f0-6b20-4438-a5a2-33d169b9bc35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:48.046617 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cd2396f0-6b20-4438-a5a2-33d169b9bc35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:48.047387 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cd2396f0-6b20-4438-a5a2-33d169b9bc35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:48.125303 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-cd2396f0-6b20-4438-a5a2-33d169b9bc35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:48.137380 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7c7b632e-1f17-469d-b3c7-443fe2df1e6f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:48.138629 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7c7b632e-1f17-469d-b3c7-443fe2df1e6f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:48.145621 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7c7b632e-1f17-469d-b3c7-443fe2df1e6f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:48.148275 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-cd2396f0-6b20-4438-a5a2-33d169b9bc35 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1304 microversion: 2.1 time: 0.129353 Aug 04 10:27:48.148860 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 186/406] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:48 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:48.162748 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7c7b632e-1f17-469d-b3c7-443fe2df1e6f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:48.163547 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7c7b632e-1f17-469d-b3c7-443fe2df1e6f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:48.164009 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7c7b632e-1f17-469d-b3c7-443fe2df1e6f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:48.331761 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7c7b632e-1f17-469d-b3c7-443fe2df1e6f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:48.340429 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7c7b632e-1f17-469d-b3c7-443fe2df1e6f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:48.342052 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7c7b632e-1f17-469d-b3c7-443fe2df1e6f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:48.343283 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7c7b632e-1f17-469d-b3c7-443fe2df1e6f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.209888 Aug 04 10:27:48.344299 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 221/407] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:48 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:49.170636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-887b1d62-1231-4880-a8f2-ee9039b848c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:49.173114 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-887b1d62-1231-4880-a8f2-ee9039b848c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:49.185754 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-887b1d62-1231-4880-a8f2-ee9039b848c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:49.187917 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-887b1d62-1231-4880-a8f2-ee9039b848c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:49.188782 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-887b1d62-1231-4880-a8f2-ee9039b848c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:49.189266 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-887b1d62-1231-4880-a8f2-ee9039b848c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:49.309159 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-887b1d62-1231-4880-a8f2-ee9039b848c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:49.317697 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-887b1d62-1231-4880-a8f2-ee9039b848c1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1302 microversion: 2.1 time: 0.151885 Aug 04 10:27:49.320467 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 187/408] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:49 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1302 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:49.370024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-73318c73-10e8-493f-9711-5b0ef71f2d99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:49.371381 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-73318c73-10e8-493f-9711-5b0ef71f2d99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:49.381377 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-73318c73-10e8-493f-9711-5b0ef71f2d99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:49.382196 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-73318c73-10e8-493f-9711-5b0ef71f2d99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:49.384334 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-73318c73-10e8-493f-9711-5b0ef71f2d99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:49.385201 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-73318c73-10e8-493f-9711-5b0ef71f2d99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:49.552575 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-73318c73-10e8-493f-9711-5b0ef71f2d99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:49.561386 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-73318c73-10e8-493f-9711-5b0ef71f2d99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:49.562968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-73318c73-10e8-493f-9711-5b0ef71f2d99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:49.564342 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-73318c73-10e8-493f-9711-5b0ef71f2d99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.200941 Aug 04 10:27:49.572419 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 222/409] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:49 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:50.343117 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-411c4e68-494a-4564-836f-7c75c72f6087 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:50.346233 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-411c4e68-494a-4564-836f-7c75c72f6087 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:50.367495 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-411c4e68-494a-4564-836f-7c75c72f6087 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:50.374705 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-411c4e68-494a-4564-836f-7c75c72f6087 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:50.379244 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-411c4e68-494a-4564-836f-7c75c72f6087 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:50.381359 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-411c4e68-494a-4564-836f-7c75c72f6087 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:50.413864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:50.549090 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-411c4e68-494a-4564-836f-7c75c72f6087 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:50.557014 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-411c4e68-494a-4564-836f-7c75c72f6087 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.220818 Aug 04 10:27:50.558520 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 188/410] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:50 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:50.586818 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-45daa272-273a-45e3-8f2e-63af1906ef37 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:50.587402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-45daa272-273a-45e3-8f2e-63af1906ef37 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:50.594663 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-45daa272-273a-45e3-8f2e-63af1906ef37 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:50.595111 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-45daa272-273a-45e3-8f2e-63af1906ef37 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:50.595880 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-45daa272-273a-45e3-8f2e-63af1906ef37 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:50.596347 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-45daa272-273a-45e3-8f2e-63af1906ef37 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:50.822888 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-45daa272-273a-45e3-8f2e-63af1906ef37 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:50.832577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-45daa272-273a-45e3-8f2e-63af1906ef37 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:50.834160 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-45daa272-273a-45e3-8f2e-63af1906ef37 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:50.835464 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-45daa272-273a-45e3-8f2e-63af1906ef37 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.252615 Aug 04 10:27:50.859125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 223/411] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:50 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:51.014799 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-49c1f1ba-750c-4750-b366-5abcd55c0f98 req-21dfb129-247c-4976-b0ec-df496d01416d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2293ba-55aa-43f6-a08d-06a3995d3fda", "tag": "639fe804-03ce-41d5-8378-a5c1423f8ab2"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:27:51.033934 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-49c1f1ba-750c-4750-b366-5abcd55c0f98 req-21dfb129-247c-4976-b0ec-df496d01416d service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:51.034628 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-49c1f1ba-750c-4750-b366-5abcd55c0f98 req-21dfb129-247c-4976-b0ec-df496d01416d service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:51.058202 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-49c1f1ba-750c-4750-b366-5abcd55c0f98 req-21dfb129-247c-4976-b0ec-df496d01416d service nova] Creating event network-changed:639fe804-03ce-41d5-8378-a5c1423f8ab2 for instance fd2293ba-55aa-43f6-a08d-06a3995d3fda on hv-cinder-82660 Aug 04 10:27:51.069234 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-49c1f1ba-750c-4750-b366-5abcd55c0f98 req-21dfb129-247c-4976-b0ec-df496d01416d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058474 Aug 04 10:27:51.070268 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 189/412] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:51.584240 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-10e75640-0ff2-436b-a01a-acad1fba5fc5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:51.585142 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-10e75640-0ff2-436b-a01a-acad1fba5fc5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:51.592157 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-10e75640-0ff2-436b-a01a-acad1fba5fc5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:51.594617 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-10e75640-0ff2-436b-a01a-acad1fba5fc5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:51.596397 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-10e75640-0ff2-436b-a01a-acad1fba5fc5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:51.597441 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-10e75640-0ff2-436b-a01a-acad1fba5fc5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:51.752182 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-10e75640-0ff2-436b-a01a-acad1fba5fc5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:51.754876 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:51.763447 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-10e75640-0ff2-436b-a01a-acad1fba5fc5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.185045 Aug 04 10:27:51.764548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 224/413] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:51 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:51.867102 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9fb1ddf6-741d-45f0-a049-871f34e4b1c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:51.867800 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9fb1ddf6-741d-45f0-a049-871f34e4b1c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:51.893018 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9fb1ddf6-741d-45f0-a049-871f34e4b1c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:51.893548 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9fb1ddf6-741d-45f0-a049-871f34e4b1c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:51.894588 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9fb1ddf6-741d-45f0-a049-871f34e4b1c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:51.894737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9fb1ddf6-741d-45f0-a049-871f34e4b1c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:52.047820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9fb1ddf6-741d-45f0-a049-871f34e4b1c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:52.057869 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9fb1ddf6-741d-45f0-a049-871f34e4b1c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:52.059414 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9fb1ddf6-741d-45f0-a049-871f34e4b1c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:52.060734 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9fb1ddf6-741d-45f0-a049-871f34e4b1c0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.197848 Aug 04 10:27:52.061313 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 190/414] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:51 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:52.785238 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d9e8353f-162a-451d-a18b-fba56d242908 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:52.785826 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d9e8353f-162a-451d-a18b-fba56d242908 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:52.792790 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9e8353f-162a-451d-a18b-fba56d242908 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:52.793234 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9e8353f-162a-451d-a18b-fba56d242908 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:52.794254 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9e8353f-162a-451d-a18b-fba56d242908 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:52.795188 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d9e8353f-162a-451d-a18b-fba56d242908 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:52.937106 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d9e8353f-162a-451d-a18b-fba56d242908 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:52.945233 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d9e8353f-162a-451d-a18b-fba56d242908 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.164191 Aug 04 10:27:52.946464 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 225/415] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:52 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:53.084765 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-bd14566a-c637-4317-a338-59e4fd0eb81c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:53.085282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-bd14566a-c637-4317-a338-59e4fd0eb81c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:53.092354 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd14566a-c637-4317-a338-59e4fd0eb81c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:53.092800 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd14566a-c637-4317-a338-59e4fd0eb81c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:53.093551 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd14566a-c637-4317-a338-59e4fd0eb81c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:53.093980 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd14566a-c637-4317-a338-59e4fd0eb81c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:53.196248 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:53.221053 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bd14566a-c637-4317-a338-59e4fd0eb81c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:53.228804 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bd14566a-c637-4317-a338-59e4fd0eb81c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:53.230315 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bd14566a-c637-4317-a338-59e4fd0eb81c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:53.231459 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-bd14566a-c637-4317-a338-59e4fd0eb81c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.150663 Aug 04 10:27:53.232036 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 191/416] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:53 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:53.968740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8ad15b7b-e23e-4d62-94f7-eff85d6c5962 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:53.969423 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8ad15b7b-e23e-4d62-94f7-eff85d6c5962 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:53.971401 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:53.977192 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8ad15b7b-e23e-4d62-94f7-eff85d6c5962 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:53.977651 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8ad15b7b-e23e-4d62-94f7-eff85d6c5962 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:53.978432 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8ad15b7b-e23e-4d62-94f7-eff85d6c5962 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:53.978923 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8ad15b7b-e23e-4d62-94f7-eff85d6c5962 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:54.118715 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8ad15b7b-e23e-4d62-94f7-eff85d6c5962 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:54.126548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8ad15b7b-e23e-4d62-94f7-eff85d6c5962 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.162593 Aug 04 10:27:54.127143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 226/417] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:53 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:54.254309 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a08092af-ead5-4eda-93a6-30b16aa0be85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:54.255064 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a08092af-ead5-4eda-93a6-30b16aa0be85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:54.257347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=6 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:54.264273 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a08092af-ead5-4eda-93a6-30b16aa0be85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:54.264727 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a08092af-ead5-4eda-93a6-30b16aa0be85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:54.265534 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a08092af-ead5-4eda-93a6-30b16aa0be85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:54.265978 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a08092af-ead5-4eda-93a6-30b16aa0be85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:54.401933 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a08092af-ead5-4eda-93a6-30b16aa0be85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:54.411438 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a08092af-ead5-4eda-93a6-30b16aa0be85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:54.413000 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a08092af-ead5-4eda-93a6-30b16aa0be85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:54.414162 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a08092af-ead5-4eda-93a6-30b16aa0be85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1740 microversion: 2.20 time: 0.164025 Aug 04 10:27:54.414722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 192/418] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:54 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:55.146726 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-201fd910-53f3-446c-883c-07e204b238f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:55.147338 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-201fd910-53f3-446c-883c-07e204b238f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:55.154168 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-201fd910-53f3-446c-883c-07e204b238f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:55.154620 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-201fd910-53f3-446c-883c-07e204b238f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:55.155394 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-201fd910-53f3-446c-883c-07e204b238f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:55.155834 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-201fd910-53f3-446c-883c-07e204b238f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:55.302115 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-201fd910-53f3-446c-883c-07e204b238f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:55.309611 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-201fd910-53f3-446c-883c-07e204b238f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.166807 Aug 04 10:27:55.310743 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 227/419] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:55 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:55.437963 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-30607788-5ae3-4b5c-b80c-3f4675d29cc1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:55.438556 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-30607788-5ae3-4b5c-b80c-3f4675d29cc1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:55.445263 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-30607788-5ae3-4b5c-b80c-3f4675d29cc1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:55.445708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-30607788-5ae3-4b5c-b80c-3f4675d29cc1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:55.446469 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-30607788-5ae3-4b5c-b80c-3f4675d29cc1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:55.446895 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-30607788-5ae3-4b5c-b80c-3f4675d29cc1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:55.580196 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-30607788-5ae3-4b5c-b80c-3f4675d29cc1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:55.588166 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-30607788-5ae3-4b5c-b80c-3f4675d29cc1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:55.589686 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-30607788-5ae3-4b5c-b80c-3f4675d29cc1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:55.590833 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-30607788-5ae3-4b5c-b80c-3f4675d29cc1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1722 microversion: 2.20 time: 0.157507 Aug 04 10:27:55.591879 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 193/420] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:55 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:27:56.331905 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ffb3a897-3b2b-49d6-a850-ee2a341dfe7e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:56.332528 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ffb3a897-3b2b-49d6-a850-ee2a341dfe7e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:56.339141 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ffb3a897-3b2b-49d6-a850-ee2a341dfe7e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:56.339590 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ffb3a897-3b2b-49d6-a850-ee2a341dfe7e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:56.340380 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ffb3a897-3b2b-49d6-a850-ee2a341dfe7e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:56.340925 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ffb3a897-3b2b-49d6-a850-ee2a341dfe7e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:56.468814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ffb3a897-3b2b-49d6-a850-ee2a341dfe7e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:56.476323 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ffb3a897-3b2b-49d6-a850-ee2a341dfe7e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.148228 Aug 04 10:27:56.476887 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 228/421] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:56 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:27:56.613746 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-db762e8d-448d-4dec-b20d-68a4d056e445 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:56.614346 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-db762e8d-448d-4dec-b20d-68a4d056e445 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:56.621120 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-db762e8d-448d-4dec-b20d-68a4d056e445 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:56.621571 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-db762e8d-448d-4dec-b20d-68a4d056e445 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:56.622954 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-db762e8d-448d-4dec-b20d-68a4d056e445 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:56.623386 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-db762e8d-448d-4dec-b20d-68a4d056e445 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:56.754778 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-db762e8d-448d-4dec-b20d-68a4d056e445 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:56.762974 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-db762e8d-448d-4dec-b20d-68a4d056e445 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:56.764487 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-db762e8d-448d-4dec-b20d-68a4d056e445 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:56.765658 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-db762e8d-448d-4dec-b20d-68a4d056e445 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1722 microversion: 2.20 time: 0.155852 Aug 04 10:27:56.766202 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 194/422] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:56 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:57.496657 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-104f8db5-5901-429e-ab8f-491fe4eabe95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:57.497268 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-104f8db5-5901-429e-ab8f-491fe4eabe95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:57.504297 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-104f8db5-5901-429e-ab8f-491fe4eabe95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:57.504743 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-104f8db5-5901-429e-ab8f-491fe4eabe95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:57.505498 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-104f8db5-5901-429e-ab8f-491fe4eabe95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:57.505929 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-104f8db5-5901-429e-ab8f-491fe4eabe95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:57.636327 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-104f8db5-5901-429e-ab8f-491fe4eabe95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:57.644315 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-104f8db5-5901-429e-ab8f-491fe4eabe95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.151501 Aug 04 10:27:57.644817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 229/423] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:57 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:57.787921 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-868e0f55-b189-49fd-9dab-361eb67b7e0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:57.788553 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-868e0f55-b189-49fd-9dab-361eb67b7e0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:57.795025 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-868e0f55-b189-49fd-9dab-361eb67b7e0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:57.795472 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-868e0f55-b189-49fd-9dab-361eb67b7e0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:57.796257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-868e0f55-b189-49fd-9dab-361eb67b7e0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:57.796687 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-868e0f55-b189-49fd-9dab-361eb67b7e0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:57.929914 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-868e0f55-b189-49fd-9dab-361eb67b7e0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:57.938799 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-868e0f55-b189-49fd-9dab-361eb67b7e0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:57.940368 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-868e0f55-b189-49fd-9dab-361eb67b7e0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:57.941542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-868e0f55-b189-49fd-9dab-361eb67b7e0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1722 microversion: 2.20 time: 0.157607 Aug 04 10:27:57.942116 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 195/424] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:57 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:58.665441 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-082a0b90-6164-498f-9874-06c6758ed839 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:58.666047 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-082a0b90-6164-498f-9874-06c6758ed839 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:58.673347 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-082a0b90-6164-498f-9874-06c6758ed839 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:58.674046 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-082a0b90-6164-498f-9874-06c6758ed839 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:58.674813 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-082a0b90-6164-498f-9874-06c6758ed839 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:58.675249 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-082a0b90-6164-498f-9874-06c6758ed839 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:58.804546 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-082a0b90-6164-498f-9874-06c6758ed839 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:58.811194 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-082a0b90-6164-498f-9874-06c6758ed839 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.149599 Aug 04 10:27:58.811779 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 230/425] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:58 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:58.965220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-32e0cee9-ace8-45a1-bb39-7340e5c5a379 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:58.965752 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-32e0cee9-ace8-45a1-bb39-7340e5c5a379 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:58.972954 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-32e0cee9-ace8-45a1-bb39-7340e5c5a379 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:58.973431 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-32e0cee9-ace8-45a1-bb39-7340e5c5a379 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:58.974185 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-32e0cee9-ace8-45a1-bb39-7340e5c5a379 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:58.974619 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-32e0cee9-ace8-45a1-bb39-7340e5c5a379 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:59.103503 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-32e0cee9-ace8-45a1-bb39-7340e5c5a379 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:59.111449 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-32e0cee9-ace8-45a1-bb39-7340e5c5a379 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:59.112986 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-32e0cee9-ace8-45a1-bb39-7340e5c5a379 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:59.114134 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-32e0cee9-ace8-45a1-bb39-7340e5c5a379 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1722 microversion: 2.20 time: 0.152902 Aug 04 10:27:59.114685 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 196/426] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:27:58 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:59.831383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-578896ab-00ad-49e9-a07a-b43ec5815b1c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:59.832019 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-578896ab-00ad-49e9-a07a-b43ec5815b1c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:27:59.838471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-578896ab-00ad-49e9-a07a-b43ec5815b1c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:59.838923 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-578896ab-00ad-49e9-a07a-b43ec5815b1c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:59.839695 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-578896ab-00ad-49e9-a07a-b43ec5815b1c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:27:59.840168 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-578896ab-00ad-49e9-a07a-b43ec5815b1c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:27:59.976764 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-578896ab-00ad-49e9-a07a-b43ec5815b1c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:27:59.984336 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-578896ab-00ad-49e9-a07a-b43ec5815b1c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.156718 Aug 04 10:27:59.984903 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 231/427] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:27:59 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:00.137196 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-12e9a860-a42c-437c-9722-9760d686732a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:00.137737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-12e9a860-a42c-437c-9722-9760d686732a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:00.144566 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-12e9a860-a42c-437c-9722-9760d686732a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:00.145007 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-12e9a860-a42c-437c-9722-9760d686732a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:00.145762 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-12e9a860-a42c-437c-9722-9760d686732a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:00.146195 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-12e9a860-a42c-437c-9722-9760d686732a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:00.276924 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-12e9a860-a42c-437c-9722-9760d686732a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:00.284967 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-12e9a860-a42c-437c-9722-9760d686732a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:00.286475 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-12e9a860-a42c-437c-9722-9760d686732a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:00.287626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-12e9a860-a42c-437c-9722-9760d686732a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1722 microversion: 2.20 time: 0.154413 Aug 04 10:28:00.288206 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 197/428] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:00 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:01.005482 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fc3a33fd-c9d7-47ef-a326-232ff4f08a95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:01.006140 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fc3a33fd-c9d7-47ef-a326-232ff4f08a95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:01.013882 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc3a33fd-c9d7-47ef-a326-232ff4f08a95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:01.014361 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc3a33fd-c9d7-47ef-a326-232ff4f08a95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:01.015139 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc3a33fd-c9d7-47ef-a326-232ff4f08a95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:01.015574 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fc3a33fd-c9d7-47ef-a326-232ff4f08a95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:01.311758 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-bc3233ee-3741-47a5-b982-80e6f6d8c36f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:01.312529 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-bc3233ee-3741-47a5-b982-80e6f6d8c36f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:01.319106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bc3233ee-3741-47a5-b982-80e6f6d8c36f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:01.320048 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bc3233ee-3741-47a5-b982-80e6f6d8c36f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:01.321026 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bc3233ee-3741-47a5-b982-80e6f6d8c36f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:01.321634 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bc3233ee-3741-47a5-b982-80e6f6d8c36f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:01.430914 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fc3a33fd-c9d7-47ef-a326-232ff4f08a95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:01.436873 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fc3a33fd-c9d7-47ef-a326-232ff4f08a95 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.435355 Aug 04 10:28:01.437791 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 232/429] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:01 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:28:01.501262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1989565767", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-274711633", "security_groups": [{"name": "tempest-secgroup-smoke-1551120339"}], "block_device_mapping_v2": [{"uuid": "4fe6d17c-2840-490b-941f-c2305488e992", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3eadf84-c470-4284-bd83-89e428b31aa1"}]}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:01.503587 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bc3233ee-3741-47a5-b982-80e6f6d8c36f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:01.511595 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bc3233ee-3741-47a5-b982-80e6f6d8c36f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:01.513697 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bc3233ee-3741-47a5-b982-80e6f6d8c36f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:01.514862 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-bc3233ee-3741-47a5-b982-80e6f6d8c36f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1722 microversion: 2.20 time: 0.207645 Aug 04 10:28:01.515424 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 198/430] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:01 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:01.612870 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] validate_networks() for [('a3eadf84-c470-4284-bd83-89e428b31aa1', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:28:01.974918 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:28:01.975341 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:28:01.975814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:28:01.976257 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:28:01.976701 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:28:01.985995 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:01.986439 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:01.987234 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:01.987668 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:02.004875 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Getting quotas for project 82b077dd80c54b08ba3ad79b8cafd3f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:28:02.008832 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Getting quotas for user fd829e78e710440687678701fea3cf2c and project 82b077dd80c54b08ba3ad79b8cafd3f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:28:02.067109 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:28:02.069245 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4fe6d17c-2840-490b-941f-c2305488e992',volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:28:02.198770 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ff9f5fd6-01e0-473d-8a0e-d055b4488a56 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.701823 Aug 04 10:28:02.199412 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 233/431] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:28:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 10:28:02.210298 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-68bce58b-4ac9-43f0-a8aa-4bfd75686340 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:02.210909 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-68bce58b-4ac9-43f0-a8aa-4bfd75686340 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:02.264877 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-68bce58b-4ac9-43f0-a8aa-4bfd75686340 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:02.272677 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-68bce58b-4ac9-43f0-a8aa-4bfd75686340 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1094 microversion: 2.1 time: 0.066123 Aug 04 10:28:02.273376 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 199/432] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:02 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:02.458990 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c02de23f-e4ec-4bbd-9586-55c4ff26ea0d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:02.459796 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c02de23f-e4ec-4bbd-9586-55c4ff26ea0d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:02.466869 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c02de23f-e4ec-4bbd-9586-55c4ff26ea0d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:02.467323 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c02de23f-e4ec-4bbd-9586-55c4ff26ea0d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:02.468131 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c02de23f-e4ec-4bbd-9586-55c4ff26ea0d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:02.468569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c02de23f-e4ec-4bbd-9586-55c4ff26ea0d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:02.538364 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-08d71666-5dea-4cae-a272-079837dd9b9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:02.539020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-08d71666-5dea-4cae-a272-079837dd9b9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:02.545833 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-08d71666-5dea-4cae-a272-079837dd9b9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:02.546281 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-08d71666-5dea-4cae-a272-079837dd9b9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:02.547052 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-08d71666-5dea-4cae-a272-079837dd9b9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:02.547661 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-08d71666-5dea-4cae-a272-079837dd9b9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:02.645135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c02de23f-e4ec-4bbd-9586-55c4ff26ea0d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:02.654803 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c02de23f-e4ec-4bbd-9586-55c4ff26ea0d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.200819 Aug 04 10:28:02.655825 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 234/433] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:02 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:02.719000 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-08d71666-5dea-4cae-a272-079837dd9b9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:02.727017 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-08d71666-5dea-4cae-a272-079837dd9b9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:02.728569 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-08d71666-5dea-4cae-a272-079837dd9b9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:02.729722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-08d71666-5dea-4cae-a272-079837dd9b9e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1722 microversion: 2.20 time: 0.195389 Aug 04 10:28:02.730282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 200/434] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:02 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:28:02.988260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-56dd9d96-a6a5-45a1-8151-84f1b048ed3d req-82146f09-f2d0-40ef-acbd-e8da2dd70559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0396f5e6-1b64-4b0f-9352-28165af5878b", "name": "network-vif-unplugged", "status": "completed", "tag": "46e7bd28-a5a1-4c48-aa21-1a4902096c91"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:02.998789 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-56dd9d96-a6a5-45a1-8151-84f1b048ed3d req-82146f09-f2d0-40ef-acbd-e8da2dd70559 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:02.999248 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-56dd9d96-a6a5-45a1-8151-84f1b048ed3d req-82146f09-f2d0-40ef-acbd-e8da2dd70559 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:03.012207 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-56dd9d96-a6a5-45a1-8151-84f1b048ed3d req-82146f09-f2d0-40ef-acbd-e8da2dd70559 service nova] Creating event network-vif-unplugged:46e7bd28-a5a1-4c48-aa21-1a4902096c91 for instance 0396f5e6-1b64-4b0f-9352-28165af5878b on hv-cinder-82660 Aug 04 10:28:03.019299 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-56dd9d96-a6a5-45a1-8151-84f1b048ed3d req-82146f09-f2d0-40ef-acbd-e8da2dd70559 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034582 Aug 04 10:28:03.020331 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 235/435] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:28:03.171882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ad0bb424-6460-4a27-8536-def00a9a7cbd tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:03.172386 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ad0bb424-6460-4a27-8536-def00a9a7cbd tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:03.181844 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ad0bb424-6460-4a27-8536-def00a9a7cbd tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:03.182218 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ad0bb424-6460-4a27-8536-def00a9a7cbd tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:03.182988 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ad0bb424-6460-4a27-8536-def00a9a7cbd tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:03.183632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ad0bb424-6460-4a27-8536-def00a9a7cbd tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:03.294544 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-aa7a64dd-2a5d-46fd-b14b-6099d1a17b1b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:03.295237 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-aa7a64dd-2a5d-46fd-b14b-6099d1a17b1b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:03.301826 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aa7a64dd-2a5d-46fd-b14b-6099d1a17b1b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:03.302340 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aa7a64dd-2a5d-46fd-b14b-6099d1a17b1b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:03.303325 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aa7a64dd-2a5d-46fd-b14b-6099d1a17b1b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:03.303831 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aa7a64dd-2a5d-46fd-b14b-6099d1a17b1b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:03.311828 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-ad0bb424-6460-4a27-8536-def00a9a7cbd tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lazy-loading 'services' on Instance uuid 67c66993-74b2-46a9-a9d1-c954c3d7fd2b {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:28:03.367791 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-aa7a64dd-2a5d-46fd-b14b-6099d1a17b1b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:03.376018 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-aa7a64dd-2a5d-46fd-b14b-6099d1a17b1b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1192 microversion: 2.1 time: 0.085563 Aug 04 10:28:03.376587 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 236/436] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:03 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:28:03.426163 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ad0bb424-6460-4a27-8536-def00a9a7cbd tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "DELETE /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b/os-volume_attachments/db7e30ef-8c08-45af-8242-44923b6f04dc" status: 202 len: 0 microversion: 2.1 time: 0.258424 Aug 04 10:28:03.426742 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 201/437] 10.222.0.72 () {58 vars in 1416 bytes} [Thu Aug 4 10:28:03 2022] DELETE /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b/os-volume_attachments/db7e30ef-8c08-45af-8242-44923b6f04dc => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:28:03.675400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1dfe0788-d961-44e5-92df-48d11bb01174 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:03.676093 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1dfe0788-d961-44e5-92df-48d11bb01174 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:03.682123 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1dfe0788-d961-44e5-92df-48d11bb01174 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:03.682575 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1dfe0788-d961-44e5-92df-48d11bb01174 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:03.683332 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1dfe0788-d961-44e5-92df-48d11bb01174 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:03.683771 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1dfe0788-d961-44e5-92df-48d11bb01174 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:03.754192 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9147f0b7-9400-40dd-8be7-c4d57b312d1f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:03.755038 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9147f0b7-9400-40dd-8be7-c4d57b312d1f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:03.762575 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9147f0b7-9400-40dd-8be7-c4d57b312d1f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:03.763070 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9147f0b7-9400-40dd-8be7-c4d57b312d1f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:03.763881 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9147f0b7-9400-40dd-8be7-c4d57b312d1f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:03.764351 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9147f0b7-9400-40dd-8be7-c4d57b312d1f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:03.852915 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1dfe0788-d961-44e5-92df-48d11bb01174 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:03.861001 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1dfe0788-d961-44e5-92df-48d11bb01174 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.189708 Aug 04 10:28:03.861581 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 237/438] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:03 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:03.914723 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9147f0b7-9400-40dd-8be7-c4d57b312d1f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:03.923352 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9147f0b7-9400-40dd-8be7-c4d57b312d1f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:03.925204 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9147f0b7-9400-40dd-8be7-c4d57b312d1f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:03.926349 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9147f0b7-9400-40dd-8be7-c4d57b312d1f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1725 microversion: 2.20 time: 0.176704 Aug 04 10:28:03.927015 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 202/439] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:03 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:28:03.950559 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6902c53e-4591-4d9f-9292-df216aa31bfb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c7f6a4f-bfb6-4457-9de7-593cf7b5df3f"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:03.953012 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6902c53e-4591-4d9f-9292-df216aa31bfb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:03.960006 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6902c53e-4591-4d9f-9292-df216aa31bfb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:03.960428 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6902c53e-4591-4d9f-9292-df216aa31bfb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:03.961185 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6902c53e-4591-4d9f-9292-df216aa31bfb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:03.961716 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6902c53e-4591-4d9f-9292-df216aa31bfb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:04.275182 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6902c53e-4591-4d9f-9292-df216aa31bfb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "POST /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.330094 Aug 04 10:28:04.275848 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 238/440] 10.222.0.72 () {62 vars in 1364 bytes} [Thu Aug 4 10:28:03 2022] POST /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/os-volume_attachments => generated 188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:28:04.395937 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0874490c-c243-4c37-bc28-a229c966b38f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:04.396591 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0874490c-c243-4c37-bc28-a229c966b38f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:04.402593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0874490c-c243-4c37-bc28-a229c966b38f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:04.403031 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0874490c-c243-4c37-bc28-a229c966b38f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:04.404357 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0874490c-c243-4c37-bc28-a229c966b38f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:04.404787 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0874490c-c243-4c37-bc28-a229c966b38f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:04.411079 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3e31c22d-c63e-4f71-b6ee-b58d19bbcc09 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:04.411676 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3e31c22d-c63e-4f71-b6ee-b58d19bbcc09 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:04.418490 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3e31c22d-c63e-4f71-b6ee-b58d19bbcc09 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:04.418942 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3e31c22d-c63e-4f71-b6ee-b58d19bbcc09 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:04.419772 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3e31c22d-c63e-4f71-b6ee-b58d19bbcc09 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:04.420245 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3e31c22d-c63e-4f71-b6ee-b58d19bbcc09 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:04.473996 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0874490c-c243-4c37-bc28-a229c966b38f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:04.478645 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3e31c22d-c63e-4f71-b6ee-b58d19bbcc09 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117666) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 10:28:04.482022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0874490c-c243-4c37-bc28-a229c966b38f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1200 microversion: 2.1 time: 0.089911 Aug 04 10:28:04.482586 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 203/441] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:04 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1200 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:04.514183 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:04.551321 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3e31c22d-c63e-4f71-b6ee-b58d19bbcc09 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "POST /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/action" status: 202 len: 0 microversion: 2.20 time: 0.144111 Aug 04 10:28:04.551932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 239/442] 10.222.0.72 () {62 vars in 1319 bytes} [Thu Aug 4 10:28:04 2022] POST /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 10:28:04.564701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-117b8267-e354-4c47-a5cd-354a286d0c28 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:04.565538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-117b8267-e354-4c47-a5cd-354a286d0c28 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:04.573003 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-117b8267-e354-4c47-a5cd-354a286d0c28 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:04.573449 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-117b8267-e354-4c47-a5cd-354a286d0c28 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:04.574224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-117b8267-e354-4c47-a5cd-354a286d0c28 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:04.574719 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-117b8267-e354-4c47-a5cd-354a286d0c28 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:04.728401 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-117b8267-e354-4c47-a5cd-354a286d0c28 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:04.739409 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-117b8267-e354-4c47-a5cd-354a286d0c28 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:04.741241 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-117b8267-e354-4c47-a5cd-354a286d0c28 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:04.742525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-117b8267-e354-4c47-a5cd-354a286d0c28 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1751 microversion: 2.20 time: 0.181672 Aug 04 10:28:04.743229 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 204/443] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:04 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:04.881583 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-30e2239f-b4c1-4e0d-a0bf-91e9803fb6ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:04.882260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-30e2239f-b4c1-4e0d-a0bf-91e9803fb6ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:04.893503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30e2239f-b4c1-4e0d-a0bf-91e9803fb6ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:04.893954 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30e2239f-b4c1-4e0d-a0bf-91e9803fb6ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:04.895514 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30e2239f-b4c1-4e0d-a0bf-91e9803fb6ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:04.895514 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30e2239f-b4c1-4e0d-a0bf-91e9803fb6ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:05.146989 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-30e2239f-b4c1-4e0d-a0bf-91e9803fb6ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:05.157353 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-30e2239f-b4c1-4e0d-a0bf-91e9803fb6ff tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.279741 Aug 04 10:28:05.167470 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 240/444] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:04 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:05.192544 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-4d2f208b-2c58-4c9d-94fd-522d2b0ab380 req-8716f5a9-4d58-4b13-8e01-51d0bd5409a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2293ba-55aa-43f6-a08d-06a3995d3fda", "name": "network-vif-plugged", "status": "completed", "tag": "639fe804-03ce-41d5-8378-a5c1423f8ab2"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:05.198629 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:05.210607 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-4d2f208b-2c58-4c9d-94fd-522d2b0ab380 req-8716f5a9-4d58-4b13-8e01-51d0bd5409a1 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:05.211333 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-4d2f208b-2c58-4c9d-94fd-522d2b0ab380 req-8716f5a9-4d58-4b13-8e01-51d0bd5409a1 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:05.225749 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-4d2f208b-2c58-4c9d-94fd-522d2b0ab380 req-8716f5a9-4d58-4b13-8e01-51d0bd5409a1 service nova] Creating event network-vif-plugged:639fe804-03ce-41d5-8378-a5c1423f8ab2 for instance fd2293ba-55aa-43f6-a08d-06a3995d3fda on hv-cinder-82660 Aug 04 10:28:05.232704 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-4d2f208b-2c58-4c9d-94fd-522d2b0ab380 req-8716f5a9-4d58-4b13-8e01-51d0bd5409a1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044444 Aug 04 10:28:05.233886 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 205/445] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:28:05.505013 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ecce275c-bcec-4e7f-82e3-d47a6ee5c9e1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:05.506249 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ecce275c-bcec-4e7f-82e3-d47a6ee5c9e1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:05.513817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ecce275c-bcec-4e7f-82e3-d47a6ee5c9e1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:05.514298 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ecce275c-bcec-4e7f-82e3-d47a6ee5c9e1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:05.515208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ecce275c-bcec-4e7f-82e3-d47a6ee5c9e1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:05.515845 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ecce275c-bcec-4e7f-82e3-d47a6ee5c9e1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:05.594020 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ecce275c-bcec-4e7f-82e3-d47a6ee5c9e1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:05.605270 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ecce275c-bcec-4e7f-82e3-d47a6ee5c9e1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1210 microversion: 2.1 time: 0.103737 Aug 04 10:28:05.606054 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 241/446] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:05 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:05.627188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4d0d4677-7d44-462c-b709-a13ae26c5b90 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:05.627766 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4d0d4677-7d44-462c-b709-a13ae26c5b90 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:05.634199 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4d0d4677-7d44-462c-b709-a13ae26c5b90 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:05.634703 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4d0d4677-7d44-462c-b709-a13ae26c5b90 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:05.635459 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4d0d4677-7d44-462c-b709-a13ae26c5b90 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:05.636118 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4d0d4677-7d44-462c-b709-a13ae26c5b90 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:05.663156 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4d0d4677-7d44-462c-b709-a13ae26c5b90 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Going to try to terminate instance {{(pid=117667) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:28:05.666297 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:05.767777 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7d7d1695-5621-4b8a-b64e-2834c420fe03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:05.769368 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7d7d1695-5621-4b8a-b64e-2834c420fe03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:05.781168 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4d0d4677-7d44-462c-b709-a13ae26c5b90 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "DELETE /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 204 len: 0 microversion: 2.1 time: 0.158790 Aug 04 10:28:05.782684 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d7d1695-5621-4b8a-b64e-2834c420fe03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:05.783878 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d7d1695-5621-4b8a-b64e-2834c420fe03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:05.785997 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d7d1695-5621-4b8a-b64e-2834c420fe03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:05.787128 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7d7d1695-5621-4b8a-b64e-2834c420fe03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:05.789313 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 206/447] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:28:05 2022] DELETE /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:28:05.795642 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-917b1d23-5508-4f41-ae78-84801f075351 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:05.796723 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-917b1d23-5508-4f41-ae78-84801f075351 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:05.803719 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-917b1d23-5508-4f41-ae78-84801f075351 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:05.804432 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-917b1d23-5508-4f41-ae78-84801f075351 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:05.805371 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-917b1d23-5508-4f41-ae78-84801f075351 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:05.805963 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-917b1d23-5508-4f41-ae78-84801f075351 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:06.009977 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7d7d1695-5621-4b8a-b64e-2834c420fe03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:06.016562 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-917b1d23-5508-4f41-ae78-84801f075351 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:06.024475 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-917b1d23-5508-4f41-ae78-84801f075351 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1515 microversion: 2.1 time: 0.233564 Aug 04 10:28:06.034640 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 207/448] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:05 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1515 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:06.034924 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7d7d1695-5621-4b8a-b64e-2834c420fe03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:06.034924 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7d7d1695-5621-4b8a-b64e-2834c420fe03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:06.034924 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7d7d1695-5621-4b8a-b64e-2834c420fe03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1751 microversion: 2.20 time: 0.266274 Aug 04 10:28:06.035250 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 242/449] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:05 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1751 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:06.178263 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d0a66c08-4513-49fd-b5c4-d53b96fe5e39 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:06.178864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-d0a66c08-4513-49fd-b5c4-d53b96fe5e39 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:06.184869 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d0a66c08-4513-49fd-b5c4-d53b96fe5e39 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:06.185317 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d0a66c08-4513-49fd-b5c4-d53b96fe5e39 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:06.186070 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d0a66c08-4513-49fd-b5c4-d53b96fe5e39 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:06.186498 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d0a66c08-4513-49fd-b5c4-d53b96fe5e39 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:06.320604 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d0a66c08-4513-49fd-b5c4-d53b96fe5e39 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:06.328545 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d0a66c08-4513-49fd-b5c4-d53b96fe5e39 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.154125 Aug 04 10:28:06.329107 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 208/450] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:06 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:06.629391 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-50683fa9-d344-430c-b855-6958c00f5983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:06.629997 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-50683fa9-d344-430c-b855-6958c00f5983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:06.636119 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50683fa9-d344-430c-b855-6958c00f5983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:06.636569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50683fa9-d344-430c-b855-6958c00f5983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:06.637328 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50683fa9-d344-430c-b855-6958c00f5983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:06.638263 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50683fa9-d344-430c-b855-6958c00f5983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:06.769769 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-50683fa9-d344-430c-b855-6958c00f5983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:06.777137 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-50683fa9-d344-430c-b855-6958c00f5983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1278 microversion: 2.1 time: 0.151638 Aug 04 10:28:06.777691 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 243/451] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:06 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:07.044666 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0c835a73-269f-4360-883a-b11d6b1c4164 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:07.045272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0c835a73-269f-4360-883a-b11d6b1c4164 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:07.050704 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-13d4b038-5668-4ec8-95dd-591efc95dcdb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:07.051301 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-13d4b038-5668-4ec8-95dd-591efc95dcdb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:07.051560 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0c835a73-269f-4360-883a-b11d6b1c4164 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:07.052035 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0c835a73-269f-4360-883a-b11d6b1c4164 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:07.052799 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0c835a73-269f-4360-883a-b11d6b1c4164 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:07.053238 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0c835a73-269f-4360-883a-b11d6b1c4164 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:07.057680 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13d4b038-5668-4ec8-95dd-591efc95dcdb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:07.058128 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13d4b038-5668-4ec8-95dd-591efc95dcdb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:07.058877 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13d4b038-5668-4ec8-95dd-591efc95dcdb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:07.059296 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13d4b038-5668-4ec8-95dd-591efc95dcdb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:07.253007 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0c835a73-269f-4360-883a-b11d6b1c4164 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:07.256125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-13d4b038-5668-4ec8-95dd-591efc95dcdb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:07.260704 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0c835a73-269f-4360-883a-b11d6b1c4164 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1515 microversion: 2.1 time: 0.219867 Aug 04 10:28:07.261274 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 209/452] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:07 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1515 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:07.265811 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-13d4b038-5668-4ec8-95dd-591efc95dcdb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:07.267312 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-13d4b038-5668-4ec8-95dd-591efc95dcdb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:07.268495 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-13d4b038-5668-4ec8-95dd-591efc95dcdb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1751 microversion: 2.20 time: 0.221904 Aug 04 10:28:07.269041 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 244/453] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:07 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1751 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:28:07.349696 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-668cdccd-6363-4c99-8710-f6799219d972 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:07.350222 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-668cdccd-6363-4c99-8710-f6799219d972 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:07.356435 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-668cdccd-6363-4c99-8710-f6799219d972 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:07.356876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-668cdccd-6363-4c99-8710-f6799219d972 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:07.357627 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-668cdccd-6363-4c99-8710-f6799219d972 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:07.358557 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-668cdccd-6363-4c99-8710-f6799219d972 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:07.490042 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-668cdccd-6363-4c99-8710-f6799219d972 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:07.501502 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-668cdccd-6363-4c99-8710-f6799219d972 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.155238 Aug 04 10:28:07.502552 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 210/454] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:07 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:07.797576 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-56af6f21-d5e6-4509-acab-df2b5785a455 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:07.798186 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-56af6f21-d5e6-4509-acab-df2b5785a455 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:07.804443 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56af6f21-d5e6-4509-acab-df2b5785a455 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:07.804893 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56af6f21-d5e6-4509-acab-df2b5785a455 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:07.805645 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56af6f21-d5e6-4509-acab-df2b5785a455 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:07.806079 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-56af6f21-d5e6-4509-acab-df2b5785a455 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:07.933988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-56af6f21-d5e6-4509-acab-df2b5785a455 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:07.941899 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-56af6f21-d5e6-4509-acab-df2b5785a455 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1278 microversion: 2.1 time: 0.148187 Aug 04 10:28:07.942460 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 245/455] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:07 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:08.281187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1aaad51d-5e46-481f-9029-d9d5f778634c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:08.281832 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-1aaad51d-5e46-481f-9029-d9d5f778634c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:08.288508 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1aaad51d-5e46-481f-9029-d9d5f778634c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:08.288958 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1aaad51d-5e46-481f-9029-d9d5f778634c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:08.289726 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1aaad51d-5e46-481f-9029-d9d5f778634c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:08.290163 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1aaad51d-5e46-481f-9029-d9d5f778634c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:08.290394 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-46d70cd8-d7d0-400e-81fa-6b30422ffe85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:08.291010 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-46d70cd8-d7d0-400e-81fa-6b30422ffe85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:08.297494 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-46d70cd8-d7d0-400e-81fa-6b30422ffe85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:08.297947 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-46d70cd8-d7d0-400e-81fa-6b30422ffe85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:08.298972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-46d70cd8-d7d0-400e-81fa-6b30422ffe85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:08.299407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-46d70cd8-d7d0-400e-81fa-6b30422ffe85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:08.481862 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-1aaad51d-5e46-481f-9029-d9d5f778634c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:08.485901 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-46d70cd8-d7d0-400e-81fa-6b30422ffe85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:08.489444 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-1aaad51d-5e46-481f-9029-d9d5f778634c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1515 microversion: 2.1 time: 0.212090 Aug 04 10:28:08.490021 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 211/456] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:08 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:08.494450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-46d70cd8-d7d0-400e-81fa-6b30422ffe85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:08.495967 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-46d70cd8-d7d0-400e-81fa-6b30422ffe85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:08.497107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-46d70cd8-d7d0-400e-81fa-6b30422ffe85 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1751 microversion: 2.20 time: 0.210563 Aug 04 10:28:08.497654 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 246/457] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:08 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:28:08.522294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b1fb7991-cfec-4152-956c-dd215988727e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:08.522899 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b1fb7991-cfec-4152-956c-dd215988727e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:08.528909 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b1fb7991-cfec-4152-956c-dd215988727e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:08.529356 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b1fb7991-cfec-4152-956c-dd215988727e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:08.530109 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b1fb7991-cfec-4152-956c-dd215988727e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:08.530538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b1fb7991-cfec-4152-956c-dd215988727e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:08.665653 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b1fb7991-cfec-4152-956c-dd215988727e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:08.677151 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b1fb7991-cfec-4152-956c-dd215988727e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.158453 Aug 04 10:28:08.677955 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 212/458] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:08 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:08.962813 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ce6f01ff-f680-45e4-adbe-eae506479613 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:08.963660 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ce6f01ff-f680-45e4-adbe-eae506479613 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:08.970430 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce6f01ff-f680-45e4-adbe-eae506479613 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:08.970948 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce6f01ff-f680-45e4-adbe-eae506479613 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:08.971820 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce6f01ff-f680-45e4-adbe-eae506479613 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:08.972544 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce6f01ff-f680-45e4-adbe-eae506479613 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:09.111435 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ce6f01ff-f680-45e4-adbe-eae506479613 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:09.119011 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ce6f01ff-f680-45e4-adbe-eae506479613 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1278 microversion: 2.1 time: 0.160677 Aug 04 10:28:09.119643 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 247/459] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:08 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:09.179608 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-12ec85ba-f688-4351-a8c8-27d793502ede req-66f80165-0105-482a-8fcf-87fbd36ce39a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50c1eff-d3b4-4002-8596-abeba3280c3d", "tag": "36ab2e93-5e76-4e77-8112-8f585e52b695"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:09.189045 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-12ec85ba-f688-4351-a8c8-27d793502ede req-66f80165-0105-482a-8fcf-87fbd36ce39a service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:09.189481 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-12ec85ba-f688-4351-a8c8-27d793502ede req-66f80165-0105-482a-8fcf-87fbd36ce39a service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:09.200496 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-12ec85ba-f688-4351-a8c8-27d793502ede req-66f80165-0105-482a-8fcf-87fbd36ce39a service nova] Creating event network-changed:36ab2e93-5e76-4e77-8112-8f585e52b695 for instance a50c1eff-d3b4-4002-8596-abeba3280c3d on hv-cinder-82660 Aug 04 10:28:09.205387 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-12ec85ba-f688-4351-a8c8-27d793502ede req-66f80165-0105-482a-8fcf-87fbd36ce39a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029711 Aug 04 10:28:09.205968 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 213/460] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:28:09.510589 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-afb7ec49-a0f3-42a9-b1d5-3681cd1f6052 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:09.511186 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-afb7ec49-a0f3-42a9-b1d5-3681cd1f6052 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:09.517930 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-afb7ec49-a0f3-42a9-b1d5-3681cd1f6052 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:09.518371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-afb7ec49-a0f3-42a9-b1d5-3681cd1f6052 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:09.519122 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-afb7ec49-a0f3-42a9-b1d5-3681cd1f6052 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:09.519547 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-afb7ec49-a0f3-42a9-b1d5-3681cd1f6052 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:09.525218 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a88ced15-ad55-40af-9cbb-86a75b85a5c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:09.526305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a88ced15-ad55-40af-9cbb-86a75b85a5c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:09.537642 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a88ced15-ad55-40af-9cbb-86a75b85a5c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:09.538448 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a88ced15-ad55-40af-9cbb-86a75b85a5c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:09.539604 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a88ced15-ad55-40af-9cbb-86a75b85a5c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:09.540071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a88ced15-ad55-40af-9cbb-86a75b85a5c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:09.727222 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-afb7ec49-a0f3-42a9-b1d5-3681cd1f6052 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:09.731378 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a88ced15-ad55-40af-9cbb-86a75b85a5c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:09.739924 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-afb7ec49-a0f3-42a9-b1d5-3681cd1f6052 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1515 microversion: 2.1 time: 0.232868 Aug 04 10:28:09.740568 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a88ced15-ad55-40af-9cbb-86a75b85a5c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:09.740950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 248/461] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:09 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1515 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:09.742070 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a88ced15-ad55-40af-9cbb-86a75b85a5c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:09.743227 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a88ced15-ad55-40af-9cbb-86a75b85a5c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1753 microversion: 2.20 time: 0.225885 Aug 04 10:28:09.743897 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 214/462] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:09 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1753 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:09.746202 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-dbd0736d-e118-4933-85de-cd88821bf724 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:09.746812 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-dbd0736d-e118-4933-85de-cd88821bf724 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:09.754523 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dbd0736d-e118-4933-85de-cd88821bf724 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:09.755292 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dbd0736d-e118-4933-85de-cd88821bf724 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:09.756680 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dbd0736d-e118-4933-85de-cd88821bf724 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:09.757265 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dbd0736d-e118-4933-85de-cd88821bf724 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:09.888912 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-dbd0736d-e118-4933-85de-cd88821bf724 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:09.897848 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-dbd0736d-e118-4933-85de-cd88821bf724 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.155543 Aug 04 10:28:09.898416 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 249/463] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:09 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:10.139057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-509c7120-2b01-45a2-a826-0ddf1eeae498 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:10.140122 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-509c7120-2b01-45a2-a826-0ddf1eeae498 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:10.146664 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-509c7120-2b01-45a2-a826-0ddf1eeae498 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:10.147106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-509c7120-2b01-45a2-a826-0ddf1eeae498 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:10.147868 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-509c7120-2b01-45a2-a826-0ddf1eeae498 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:10.148326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-509c7120-2b01-45a2-a826-0ddf1eeae498 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:10.291059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-509c7120-2b01-45a2-a826-0ddf1eeae498 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:10.300055 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-509c7120-2b01-45a2-a826-0ddf1eeae498 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1278 microversion: 2.1 time: 0.164978 Aug 04 10:28:10.300634 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 215/464] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:10 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:10.761647 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9e58251e-5f96-4722-a51b-5ea2c0729fc6 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:10.762404 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9e58251e-5f96-4722-a51b-5ea2c0729fc6 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:10.766968 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e6943d2f-9e64-450b-85f5-3f5727623d20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:10.767579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e6943d2f-9e64-450b-85f5-3f5727623d20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:10.769651 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e58251e-5f96-4722-a51b-5ea2c0729fc6 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:10.770091 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e58251e-5f96-4722-a51b-5ea2c0729fc6 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:10.770846 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e58251e-5f96-4722-a51b-5ea2c0729fc6 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:10.771272 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e58251e-5f96-4722-a51b-5ea2c0729fc6 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:10.774123 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e6943d2f-9e64-450b-85f5-3f5727623d20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:10.774589 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e6943d2f-9e64-450b-85f5-3f5727623d20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:10.775317 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e6943d2f-9e64-450b-85f5-3f5727623d20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:10.775746 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e6943d2f-9e64-450b-85f5-3f5727623d20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:10.968892 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9e58251e-5f96-4722-a51b-5ea2c0729fc6 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:10.972265 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e6943d2f-9e64-450b-85f5-3f5727623d20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:10.976582 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9e58251e-5f96-4722-a51b-5ea2c0729fc6 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1515 microversion: 2.1 time: 0.218870 Aug 04 10:28:10.977328 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 250/465] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:10 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:10.981683 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cf113b1d-4a7c-44b8-aa4d-b9029ca3d666 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:10.982317 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-cf113b1d-4a7c-44b8-aa4d-b9029ca3d666 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:10.986011 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e6943d2f-9e64-450b-85f5-3f5727623d20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:10.987601 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e6943d2f-9e64-450b-85f5-3f5727623d20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:10.988439 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cf113b1d-4a7c-44b8-aa4d-b9029ca3d666 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:10.988882 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cf113b1d-4a7c-44b8-aa4d-b9029ca3d666 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:10.989119 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e6943d2f-9e64-450b-85f5-3f5727623d20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1753 microversion: 2.20 time: 0.226490 Aug 04 10:28:10.989624 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cf113b1d-4a7c-44b8-aa4d-b9029ca3d666 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:10.990462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 216/466] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:10 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1753 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:28:10.990601 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cf113b1d-4a7c-44b8-aa4d-b9029ca3d666 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:11.119442 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-cf113b1d-4a7c-44b8-aa4d-b9029ca3d666 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:11.127557 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-cf113b1d-4a7c-44b8-aa4d-b9029ca3d666 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1369 microversion: 2.1 time: 0.149240 Aug 04 10:28:11.128153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 251/467] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:10 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:11.325022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5b893853-3815-4e61-8ce6-474d98cd9616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:11.325625 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5b893853-3815-4e61-8ce6-474d98cd9616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:11.331608 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5b893853-3815-4e61-8ce6-474d98cd9616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:11.332098 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5b893853-3815-4e61-8ce6-474d98cd9616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:11.332863 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5b893853-3815-4e61-8ce6-474d98cd9616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:11.333303 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5b893853-3815-4e61-8ce6-474d98cd9616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:11.502745 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5b893853-3815-4e61-8ce6-474d98cd9616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:11.511560 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5b893853-3815-4e61-8ce6-474d98cd9616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1278 microversion: 2.1 time: 0.190295 Aug 04 10:28:11.512416 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 217/468] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:11 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:11.998151 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a540103c-4195-486c-b025-66ebd6bbac39 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:11.999177 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a540103c-4195-486c-b025-66ebd6bbac39 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:12.001507 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:12.006556 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a540103c-4195-486c-b025-66ebd6bbac39 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:12.007001 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a540103c-4195-486c-b025-66ebd6bbac39 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:12.007845 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a540103c-4195-486c-b025-66ebd6bbac39 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:12.008422 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a540103c-4195-486c-b025-66ebd6bbac39 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:12.012842 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-28f1110e-93b9-4645-94fa-e39e5c9225d7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:12.013443 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-28f1110e-93b9-4645-94fa-e39e5c9225d7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:12.020838 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-28f1110e-93b9-4645-94fa-e39e5c9225d7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:12.021287 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-28f1110e-93b9-4645-94fa-e39e5c9225d7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:12.022043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-28f1110e-93b9-4645-94fa-e39e5c9225d7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:12.022533 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-28f1110e-93b9-4645-94fa-e39e5c9225d7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:12.024845 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:12.203825 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a540103c-4195-486c-b025-66ebd6bbac39 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:12.211491 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a540103c-4195-486c-b025-66ebd6bbac39 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1515 microversion: 2.1 time: 0.217226 Aug 04 10:28:12.212034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 252/469] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:11 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:12.216712 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f1d21e92-db43-4d2f-9964-c0858a971ef1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:12.217343 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f1d21e92-db43-4d2f-9964-c0858a971ef1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:12.217861 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-28f1110e-93b9-4645-94fa-e39e5c9225d7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:12.223201 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f1d21e92-db43-4d2f-9964-c0858a971ef1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:12.223653 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f1d21e92-db43-4d2f-9964-c0858a971ef1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:12.224444 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f1d21e92-db43-4d2f-9964-c0858a971ef1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:12.224876 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f1d21e92-db43-4d2f-9964-c0858a971ef1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:12.228325 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-28f1110e-93b9-4645-94fa-e39e5c9225d7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:12.229931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-28f1110e-93b9-4645-94fa-e39e5c9225d7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:12.231170 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-28f1110e-93b9-4645-94fa-e39e5c9225d7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1753 microversion: 2.20 time: 0.222319 Aug 04 10:28:12.231717 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 218/470] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:12 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1753 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:28:12.358406 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f1d21e92-db43-4d2f-9964-c0858a971ef1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:12.366025 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f1d21e92-db43-4d2f-9964-c0858a971ef1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1563 microversion: 2.1 time: 0.153000 Aug 04 10:28:12.366588 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 253/471] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:12 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:12.387570 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9afb417c-84aa-4a47-8155-4af263358f3e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:12.388099 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9afb417c-84aa-4a47-8155-4af263358f3e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:12.390058 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:12.395747 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9afb417c-84aa-4a47-8155-4af263358f3e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:12.396454 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9afb417c-84aa-4a47-8155-4af263358f3e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:12.397265 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9afb417c-84aa-4a47-8155-4af263358f3e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:12.397702 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9afb417c-84aa-4a47-8155-4af263358f3e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:12.481125 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9afb417c-84aa-4a47-8155-4af263358f3e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097766 Aug 04 10:28:12.481951 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 219/472] 10.222.0.72 () {58 vars in 1275 bytes} [Thu Aug 4 10:28:12 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:28:12.532882 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ce2dd383-d6c4-4300-9cf7-b0af9a3b984f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:12.533895 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ce2dd383-d6c4-4300-9cf7-b0af9a3b984f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:12.541716 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce2dd383-d6c4-4300-9cf7-b0af9a3b984f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:12.542537 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce2dd383-d6c4-4300-9cf7-b0af9a3b984f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:12.543923 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce2dd383-d6c4-4300-9cf7-b0af9a3b984f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:12.544878 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce2dd383-d6c4-4300-9cf7-b0af9a3b984f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:12.889347 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ce2dd383-d6c4-4300-9cf7-b0af9a3b984f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:12.902877 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ce2dd383-d6c4-4300-9cf7-b0af9a3b984f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.372819 Aug 04 10:28:12.904554 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 254/473] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:12 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:13.234959 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9e69ee36-5e95-4505-a39f-220bfcd8dc7f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:13.235574 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9e69ee36-5e95-4505-a39f-220bfcd8dc7f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:13.246825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9e69ee36-5e95-4505-a39f-220bfcd8dc7f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:13.247542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9e69ee36-5e95-4505-a39f-220bfcd8dc7f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:13.249023 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9e69ee36-5e95-4505-a39f-220bfcd8dc7f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:13.256940 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e35de5a1-c9bd-4446-bf6f-509bafdb3421 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:13.257733 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e35de5a1-c9bd-4446-bf6f-509bafdb3421 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:13.262378 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9e69ee36-5e95-4505-a39f-220bfcd8dc7f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:13.270586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e35de5a1-c9bd-4446-bf6f-509bafdb3421 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:13.271073 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e35de5a1-c9bd-4446-bf6f-509bafdb3421 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:13.273872 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e35de5a1-c9bd-4446-bf6f-509bafdb3421 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:13.274535 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e35de5a1-c9bd-4446-bf6f-509bafdb3421 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:13.470453 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9e69ee36-5e95-4505-a39f-220bfcd8dc7f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:13.480721 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9e69ee36-5e95-4505-a39f-220bfcd8dc7f tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1473 microversion: 2.1 time: 0.250401 Aug 04 10:28:13.481328 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 220/474] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:13 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1473 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:13.486628 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-2fb63a38-54e6-41f4-ad97-941e227a1618 req-7263a79f-f61b-4358-abd8-cc228488de69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c66993-74b2-46a9-a9d1-c954c3d7fd2b", "name": "network-vif-deleted", "tag": "c32f70f1-3ac3-48e7-a8b4-6d1ba2e8d2d2"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:13.497182 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-2fb63a38-54e6-41f4-ad97-941e227a1618 req-7263a79f-f61b-4358-abd8-cc228488de69 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:13.497627 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-2fb63a38-54e6-41f4-ad97-941e227a1618 req-7263a79f-f61b-4358-abd8-cc228488de69 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:13.510085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-2fb63a38-54e6-41f4-ad97-941e227a1618 req-7263a79f-f61b-4358-abd8-cc228488de69 service nova] Creating event network-vif-deleted:c32f70f1-3ac3-48e7-a8b4-6d1ba2e8d2d2 for instance 67c66993-74b2-46a9-a9d1-c954c3d7fd2b on hv-cinder-82660 Aug 04 10:28:13.516755 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-2fb63a38-54e6-41f4-ad97-941e227a1618 req-7263a79f-f61b-4358-abd8-cc228488de69 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034245 Aug 04 10:28:13.517404 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 221/475] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:28:13.909065 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e35de5a1-c9bd-4446-bf6f-509bafdb3421 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:13.911280 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:13.918708 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e35de5a1-c9bd-4446-bf6f-509bafdb3421 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:13.921086 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e35de5a1-c9bd-4446-bf6f-509bafdb3421 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:13.921894 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e35de5a1-c9bd-4446-bf6f-509bafdb3421 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.671658 Aug 04 10:28:13.922447 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 255/476] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:13 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:13.927743 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c1ad888d-6328-44ec-8b82-c630f6d5a800 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:13.928497 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c1ad888d-6328-44ec-8b82-c630f6d5a800 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:13.934736 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c1ad888d-6328-44ec-8b82-c630f6d5a800 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:13.935186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c1ad888d-6328-44ec-8b82-c630f6d5a800 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:13.936113 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c1ad888d-6328-44ec-8b82-c630f6d5a800 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:13.937068 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c1ad888d-6328-44ec-8b82-c630f6d5a800 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:14.128278 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c1ad888d-6328-44ec-8b82-c630f6d5a800 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:14.136384 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c1ad888d-6328-44ec-8b82-c630f6d5a800 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.213196 Aug 04 10:28:14.136958 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 222/477] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:13 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:28:14.273534 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-0bf7e606-be3f-4c71-bf8c-a0f3b2c56ba1 req-316fd11f-917a-48f0-b68b-bce513a8f767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2293ba-55aa-43f6-a08d-06a3995d3fda", "tag": "639fe804-03ce-41d5-8378-a5c1423f8ab2"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:14.285688 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-0bf7e606-be3f-4c71-bf8c-a0f3b2c56ba1 req-316fd11f-917a-48f0-b68b-bce513a8f767 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:14.286134 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-0bf7e606-be3f-4c71-bf8c-a0f3b2c56ba1 req-316fd11f-917a-48f0-b68b-bce513a8f767 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:14.297923 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-0bf7e606-be3f-4c71-bf8c-a0f3b2c56ba1 req-316fd11f-917a-48f0-b68b-bce513a8f767 service nova] Creating event network-changed:639fe804-03ce-41d5-8378-a5c1423f8ab2 for instance fd2293ba-55aa-43f6-a08d-06a3995d3fda on hv-cinder-82660 Aug 04 10:28:14.303341 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-0bf7e606-be3f-4c71-bf8c-a0f3b2c56ba1 req-316fd11f-917a-48f0-b68b-bce513a8f767 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033455 Aug 04 10:28:14.304155 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 256/478] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:28:14.501996 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a14fa927-9650-46d9-809c-082f16a49ff0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:14.502600 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a14fa927-9650-46d9-809c-082f16a49ff0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:14.509239 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a14fa927-9650-46d9-809c-082f16a49ff0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:14.509683 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a14fa927-9650-46d9-809c-082f16a49ff0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:14.510441 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a14fa927-9650-46d9-809c-082f16a49ff0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:14.510877 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a14fa927-9650-46d9-809c-082f16a49ff0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:14.532192 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:14.546476 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a14fa927-9650-46d9-809c-082f16a49ff0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:14.546912 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a14fa927-9650-46d9-809c-082f16a49ff0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:14.547363 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-a14fa927-9650-46d9-809c-082f16a49ff0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lazy-loading 'fault' on Instance uuid 67c66993-74b2-46a9-a9d1-c954c3d7fd2b {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:28:14.592100 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a14fa927-9650-46d9-809c-082f16a49ff0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:14.600407 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a14fa927-9650-46d9-809c-082f16a49ff0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1309 microversion: 2.1 time: 0.102236 Aug 04 10:28:14.600983 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 223/479] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:14 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:14.946109 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c76dad8f-00f0-4d11-a8aa-b19aad1b09a6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:14.946798 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c76dad8f-00f0-4d11-a8aa-b19aad1b09a6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:14.954084 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c76dad8f-00f0-4d11-a8aa-b19aad1b09a6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:14.954527 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c76dad8f-00f0-4d11-a8aa-b19aad1b09a6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:14.955301 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c76dad8f-00f0-4d11-a8aa-b19aad1b09a6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:14.955706 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c76dad8f-00f0-4d11-a8aa-b19aad1b09a6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:15.095617 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c76dad8f-00f0-4d11-a8aa-b19aad1b09a6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:15.104505 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c76dad8f-00f0-4d11-a8aa-b19aad1b09a6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:15.106040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c76dad8f-00f0-4d11-a8aa-b19aad1b09a6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:15.107197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c76dad8f-00f0-4d11-a8aa-b19aad1b09a6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.165507 Aug 04 10:28:15.107749 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 257/480] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:14 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:15.159874 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-05a4382d-7f3b-47df-8158-31b27f100046 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:15.160578 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-05a4382d-7f3b-47df-8158-31b27f100046 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:15.167072 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-05a4382d-7f3b-47df-8158-31b27f100046 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:15.167605 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-05a4382d-7f3b-47df-8158-31b27f100046 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:15.168487 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-05a4382d-7f3b-47df-8158-31b27f100046 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:15.169100 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-05a4382d-7f3b-47df-8158-31b27f100046 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:15.339890 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-05a4382d-7f3b-47df-8158-31b27f100046 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:15.347698 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-05a4382d-7f3b-47df-8158-31b27f100046 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.192746 Aug 04 10:28:15.348226 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 224/481] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:15 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:15.626740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d2afdafe-4bb1-4b5d-b3aa-101256152800 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:15.627923 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d2afdafe-4bb1-4b5d-b3aa-101256152800 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:15.633548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:15.640472 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2afdafe-4bb1-4b5d-b3aa-101256152800 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:15.640932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2afdafe-4bb1-4b5d-b3aa-101256152800 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:15.641716 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2afdafe-4bb1-4b5d-b3aa-101256152800 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:15.642150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2afdafe-4bb1-4b5d-b3aa-101256152800 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:15.677687 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2afdafe-4bb1-4b5d-b3aa-101256152800 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:15.678132 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2afdafe-4bb1-4b5d-b3aa-101256152800 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:15.678586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-d2afdafe-4bb1-4b5d-b3aa-101256152800 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lazy-loading 'fault' on Instance uuid 67c66993-74b2-46a9-a9d1-c954c3d7fd2b {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:28:15.722070 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d2afdafe-4bb1-4b5d-b3aa-101256152800 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:15.730368 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d2afdafe-4bb1-4b5d-b3aa-101256152800 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1309 microversion: 2.1 time: 0.111946 Aug 04 10:28:15.731162 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 258/482] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:15 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:16.130122 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6640d5e0-df86-4f36-8ad4-cb385168b7ce tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:16.130638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6640d5e0-df86-4f36-8ad4-cb385168b7ce tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:16.137242 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6640d5e0-df86-4f36-8ad4-cb385168b7ce tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:16.137702 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6640d5e0-df86-4f36-8ad4-cb385168b7ce tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:16.138428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6640d5e0-df86-4f36-8ad4-cb385168b7ce tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:16.138856 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6640d5e0-df86-4f36-8ad4-cb385168b7ce tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:16.274087 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6640d5e0-df86-4f36-8ad4-cb385168b7ce tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:16.283335 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6640d5e0-df86-4f36-8ad4-cb385168b7ce tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:16.284875 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6640d5e0-df86-4f36-8ad4-cb385168b7ce tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:16.286053 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6640d5e0-df86-4f36-8ad4-cb385168b7ce tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.159988 Aug 04 10:28:16.286609 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 225/483] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:16 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:16.367753 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a2f4588e-f3ca-419c-938e-758ad8e3e249 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:16.368386 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a2f4588e-f3ca-419c-938e-758ad8e3e249 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:16.374575 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a2f4588e-f3ca-419c-938e-758ad8e3e249 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:16.375025 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a2f4588e-f3ca-419c-938e-758ad8e3e249 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:16.375793 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a2f4588e-f3ca-419c-938e-758ad8e3e249 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:16.376261 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a2f4588e-f3ca-419c-938e-758ad8e3e249 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:16.509995 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a2f4588e-f3ca-419c-938e-758ad8e3e249 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:16.518212 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a2f4588e-f3ca-419c-938e-758ad8e3e249 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.154331 Aug 04 10:28:16.519092 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 259/484] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:16 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:16.752300 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-be93604d-3311-4f6f-b7c7-57c0cfc66d8d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:16.752823 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-be93604d-3311-4f6f-b7c7-57c0cfc66d8d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:16.758856 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-be93604d-3311-4f6f-b7c7-57c0cfc66d8d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:16.759395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-be93604d-3311-4f6f-b7c7-57c0cfc66d8d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:16.760195 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-be93604d-3311-4f6f-b7c7-57c0cfc66d8d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:16.760640 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-be93604d-3311-4f6f-b7c7-57c0cfc66d8d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:16.791881 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-be93604d-3311-4f6f-b7c7-57c0cfc66d8d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:16.792365 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-be93604d-3311-4f6f-b7c7-57c0cfc66d8d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:16.792812 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-be93604d-3311-4f6f-b7c7-57c0cfc66d8d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lazy-loading 'fault' on Instance uuid 67c66993-74b2-46a9-a9d1-c954c3d7fd2b {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:28:16.837730 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-be93604d-3311-4f6f-b7c7-57c0cfc66d8d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:16.845468 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-be93604d-3311-4f6f-b7c7-57c0cfc66d8d tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 200 len: 1309 microversion: 2.1 time: 0.097633 Aug 04 10:28:16.846046 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 226/485] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:16 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:17.309770 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1d6fd239-df43-4e21-8880-dd93b779fe23 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:17.310533 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1d6fd239-df43-4e21-8880-dd93b779fe23 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:17.319250 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1d6fd239-df43-4e21-8880-dd93b779fe23 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:17.319988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1d6fd239-df43-4e21-8880-dd93b779fe23 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:17.321031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1d6fd239-df43-4e21-8880-dd93b779fe23 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:17.321957 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1d6fd239-df43-4e21-8880-dd93b779fe23 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:17.538798 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4bfff14e-c24b-4716-8f1d-f0323b5c8914 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:17.539414 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4bfff14e-c24b-4716-8f1d-f0323b5c8914 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:17.547448 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4bfff14e-c24b-4716-8f1d-f0323b5c8914 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:17.547893 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4bfff14e-c24b-4716-8f1d-f0323b5c8914 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:17.549338 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4bfff14e-c24b-4716-8f1d-f0323b5c8914 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:17.549944 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4bfff14e-c24b-4716-8f1d-f0323b5c8914 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:17.551150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1d6fd239-df43-4e21-8880-dd93b779fe23 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:17.561328 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1d6fd239-df43-4e21-8880-dd93b779fe23 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:17.563175 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-1d6fd239-df43-4e21-8880-dd93b779fe23 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:17.564513 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1d6fd239-df43-4e21-8880-dd93b779fe23 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.258930 Aug 04 10:28:17.565553 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 260/486] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:17 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:17.784422 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4bfff14e-c24b-4716-8f1d-f0323b5c8914 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:17.794056 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4bfff14e-c24b-4716-8f1d-f0323b5c8914 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.258986 Aug 04 10:28:17.808926 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 227/487] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:17 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:28:17.866570 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-41c511e3-8fcb-4516-81d1-b4aa0abbf61b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:17.867178 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-41c511e3-8fcb-4516-81d1-b4aa0abbf61b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: 67c66993-74b2-46a9-a9d1-c954c3d7fd2b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:17.873451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-41c511e3-8fcb-4516-81d1-b4aa0abbf61b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:17.874010 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-41c511e3-8fcb-4516-81d1-b4aa0abbf61b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:17.874780 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-41c511e3-8fcb-4516-81d1-b4aa0abbf61b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:17.875204 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-41c511e3-8fcb-4516-81d1-b4aa0abbf61b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:17.890177 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-41c511e3-8fcb-4516-81d1-b4aa0abbf61b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] HTTP exception thrown: Instance 67c66993-74b2-46a9-a9d1-c954c3d7fd2b could not be found. Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-41c511e3-8fcb-4516-81d1-b4aa0abbf61b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Request method failure captured: Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b HTTP/1.1 Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi657gM1WoHrHb_b9429bfYJTe6WIKZQR2azBwK82JG-mYRuJidwOFrftKzr4ou9sOGSVbMzLCbn-xWOWmO3KBht4BrZkB4nv_UxKK-M_yuBQmrMqxQobUQ6LMdiuBJAxxy0reoJpSk78lFeMr3HwHIf0FvNkVaqXJhg7ytMPxlKtoyK8 Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 25fefc765ecb42728a941ddad185e082 Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1655726524 Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:28:17.892371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:28:17.893968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/25fefc765ecb42728a941ddad185e082"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/25fefc765ecb42728a941ddad185e082"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/25fefc765ecb42728a941ddad185e082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_25fefc765ecb42728a941ddad185e082"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:28:17.893968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesSnapshotTestJSON-1655726524 Aug 04 10:28:17.893968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 25fefc765ecb42728a941ddad185e082 Aug 04 10:28:17.893968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1655726524 Aug 04 10:28:17.893968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesSnapshotTestJSON-1655726524-project Aug 04 10:28:17.893968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:28:17.893968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:28:17.893968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: f20047857e8c4e36a031813729c09a2b Aug 04 10:28:17.893968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesSnapshotTestJSON-1655726524-project Aug 04 10:28:17.893968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:28:17.893968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance 67c66993-74b2-46a9-a9d1-c954c3d7fd2b could not be found. Aug 04 10:28:17.893968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '67c66993-74b2-46a9-a9d1-c954c3d7fd2b'} Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67c66993-74b2-46a9-a9d1-c954c3d7fd2b could not be found. Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:28:17.894935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67c66993-74b2-46a9-a9d1-c954c3d7fd2b could not be found. Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67c66993-74b2-46a9-a9d1-c954c3d7fd2b could not be found. Aug 04 10:28:17.896455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:28:17.897656 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-41c511e3-8fcb-4516-81d1-b4aa0abbf61b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Returning 404 to user: Instance 67c66993-74b2-46a9-a9d1-c954c3d7fd2b could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:28:17.897656 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-41c511e3-8fcb-4516-81d1-b4aa0abbf61b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b" status: 404 len: 111 microversion: 2.1 time: 0.031046 Aug 04 10:28:17.897656 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 261/488] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:17 2022] GET /compute/v2.1/servers/67c66993-74b2-46a9-a9d1-c954c3d7fd2b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:28:18.596313 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-eeb6ea98-39b2-45fd-91ce-6239b1e0a710 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:18.596894 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-eeb6ea98-39b2-45fd-91ce-6239b1e0a710 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:18.603682 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-eeb6ea98-39b2-45fd-91ce-6239b1e0a710 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:18.604247 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-eeb6ea98-39b2-45fd-91ce-6239b1e0a710 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:18.605015 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-eeb6ea98-39b2-45fd-91ce-6239b1e0a710 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:18.605448 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-eeb6ea98-39b2-45fd-91ce-6239b1e0a710 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:18.735803 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-eeb6ea98-39b2-45fd-91ce-6239b1e0a710 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:18.744337 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-eeb6ea98-39b2-45fd-91ce-6239b1e0a710 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:18.745842 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-eeb6ea98-39b2-45fd-91ce-6239b1e0a710 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:18.746991 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-eeb6ea98-39b2-45fd-91ce-6239b1e0a710 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.154528 Aug 04 10:28:18.747553 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 228/489] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:18 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:18.816971 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f93c7746-beda-424b-abe5-1f66be72846e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:18.817579 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f93c7746-beda-424b-abe5-1f66be72846e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:18.824611 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f93c7746-beda-424b-abe5-1f66be72846e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:18.824871 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f93c7746-beda-424b-abe5-1f66be72846e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:18.825643 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f93c7746-beda-424b-abe5-1f66be72846e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:18.826080 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f93c7746-beda-424b-abe5-1f66be72846e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:18.962242 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f93c7746-beda-424b-abe5-1f66be72846e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:18.970035 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f93c7746-beda-424b-abe5-1f66be72846e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.156900 Aug 04 10:28:18.970575 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 262/490] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:18 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:19.770360 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e5f0a22f-7719-461b-9cdc-aab4c6f96590 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:19.770958 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e5f0a22f-7719-461b-9cdc-aab4c6f96590 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:19.777479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e5f0a22f-7719-461b-9cdc-aab4c6f96590 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:19.777921 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e5f0a22f-7719-461b-9cdc-aab4c6f96590 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:19.778673 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e5f0a22f-7719-461b-9cdc-aab4c6f96590 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:19.779104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e5f0a22f-7719-461b-9cdc-aab4c6f96590 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:19.930149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e5f0a22f-7719-461b-9cdc-aab4c6f96590 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:19.938982 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e5f0a22f-7719-461b-9cdc-aab4c6f96590 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:19.940472 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e5f0a22f-7719-461b-9cdc-aab4c6f96590 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:19.941624 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e5f0a22f-7719-461b-9cdc-aab4c6f96590 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.175121 Aug 04 10:28:19.942178 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 229/491] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:19 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:19.990257 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-db091fb1-2cef-44a2-a6fc-d9b52bf8eb7b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:19.990895 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-db091fb1-2cef-44a2-a6fc-d9b52bf8eb7b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:19.997352 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-db091fb1-2cef-44a2-a6fc-d9b52bf8eb7b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:19.997794 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-db091fb1-2cef-44a2-a6fc-d9b52bf8eb7b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:19.998580 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-db091fb1-2cef-44a2-a6fc-d9b52bf8eb7b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:19.999010 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-db091fb1-2cef-44a2-a6fc-d9b52bf8eb7b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:20.129582 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-db091fb1-2cef-44a2-a6fc-d9b52bf8eb7b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:20.137835 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-db091fb1-2cef-44a2-a6fc-d9b52bf8eb7b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.151368 Aug 04 10:28:20.138426 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 263/492] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:19 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:28:20.965293 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-cb9b4406-2b2e-4852-bd24-0bf49245f08e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:20.965821 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-cb9b4406-2b2e-4852-bd24-0bf49245f08e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:20.972804 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cb9b4406-2b2e-4852-bd24-0bf49245f08e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:20.973254 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cb9b4406-2b2e-4852-bd24-0bf49245f08e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:20.974019 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cb9b4406-2b2e-4852-bd24-0bf49245f08e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:20.974455 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cb9b4406-2b2e-4852-bd24-0bf49245f08e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:21.104777 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-cb9b4406-2b2e-4852-bd24-0bf49245f08e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:21.113091 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-cb9b4406-2b2e-4852-bd24-0bf49245f08e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:21.114584 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-cb9b4406-2b2e-4852-bd24-0bf49245f08e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:21.115728 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-cb9b4406-2b2e-4852-bd24-0bf49245f08e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.154566 Aug 04 10:28:21.116328 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 230/493] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:20 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:28:21.158390 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6bd424f8-a5f9-4ff6-b8b3-8948520325a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:21.159028 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6bd424f8-a5f9-4ff6-b8b3-8948520325a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:21.165647 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6bd424f8-a5f9-4ff6-b8b3-8948520325a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:21.166094 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6bd424f8-a5f9-4ff6-b8b3-8948520325a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:21.166853 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6bd424f8-a5f9-4ff6-b8b3-8948520325a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:21.167291 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6bd424f8-a5f9-4ff6-b8b3-8948520325a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:21.306074 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6bd424f8-a5f9-4ff6-b8b3-8948520325a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:21.314309 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6bd424f8-a5f9-4ff6-b8b3-8948520325a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.159673 Aug 04 10:28:21.314872 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 264/494] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:21 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:22.141162 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-75ffccf1-be01-4f6c-938d-12c078c0f94d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:22.141761 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-75ffccf1-be01-4f6c-938d-12c078c0f94d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:22.149462 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-75ffccf1-be01-4f6c-938d-12c078c0f94d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:22.149902 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-75ffccf1-be01-4f6c-938d-12c078c0f94d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:22.150693 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-75ffccf1-be01-4f6c-938d-12c078c0f94d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:22.151126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-75ffccf1-be01-4f6c-938d-12c078c0f94d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:22.334929 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-33b1e8b5-748f-44d5-a2e7-6ebfaad64465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:22.335553 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-33b1e8b5-748f-44d5-a2e7-6ebfaad64465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:22.340543 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-75ffccf1-be01-4f6c-938d-12c078c0f94d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:22.347795 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33b1e8b5-748f-44d5-a2e7-6ebfaad64465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:22.348358 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33b1e8b5-748f-44d5-a2e7-6ebfaad64465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:22.349142 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33b1e8b5-748f-44d5-a2e7-6ebfaad64465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:22.349582 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33b1e8b5-748f-44d5-a2e7-6ebfaad64465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:22.360253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-75ffccf1-be01-4f6c-938d-12c078c0f94d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:22.360253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-75ffccf1-be01-4f6c-938d-12c078c0f94d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:22.360253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-75ffccf1-be01-4f6c-938d-12c078c0f94d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.219179 Aug 04 10:28:22.368349 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 231/495] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:22 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:22.519618 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-33b1e8b5-748f-44d5-a2e7-6ebfaad64465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:22.527217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-33b1e8b5-748f-44d5-a2e7-6ebfaad64465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.196509 Aug 04 10:28:22.527934 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 265/496] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:22 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:28:23.379053 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8d78d69e-d13d-4eed-b7dd-a2602b195895 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:23.379650 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8d78d69e-d13d-4eed-b7dd-a2602b195895 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:23.386443 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8d78d69e-d13d-4eed-b7dd-a2602b195895 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:23.386882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8d78d69e-d13d-4eed-b7dd-a2602b195895 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:23.387643 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8d78d69e-d13d-4eed-b7dd-a2602b195895 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:23.388112 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8d78d69e-d13d-4eed-b7dd-a2602b195895 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:23.530695 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8d78d69e-d13d-4eed-b7dd-a2602b195895 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:23.548498 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8d78d69e-d13d-4eed-b7dd-a2602b195895 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:23.549475 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-50e7ed31-0cbf-4f64-a5c7-326ec8836ce4 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:23.550092 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-50e7ed31-0cbf-4f64-a5c7-326ec8836ce4 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:23.552037 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8d78d69e-d13d-4eed-b7dd-a2602b195895 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:23.555393 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8d78d69e-d13d-4eed-b7dd-a2602b195895 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.179992 Aug 04 10:28:23.556926 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 232/497] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:23 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:23.561870 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50e7ed31-0cbf-4f64-a5c7-326ec8836ce4 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:23.562325 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50e7ed31-0cbf-4f64-a5c7-326ec8836ce4 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:23.565292 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50e7ed31-0cbf-4f64-a5c7-326ec8836ce4 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:23.565744 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50e7ed31-0cbf-4f64-a5c7-326ec8836ce4 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:23.773178 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-50e7ed31-0cbf-4f64-a5c7-326ec8836ce4 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:23.782028 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-50e7ed31-0cbf-4f64-a5c7-326ec8836ce4 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.237546 Aug 04 10:28:23.782946 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 266/498] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:23 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:28:24.585627 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-2efba8d9-aaf2-4afc-a123-5361e18bb40d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:24.586397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-2efba8d9-aaf2-4afc-a123-5361e18bb40d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:24.595172 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2efba8d9-aaf2-4afc-a123-5361e18bb40d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:24.596161 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2efba8d9-aaf2-4afc-a123-5361e18bb40d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:24.597957 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2efba8d9-aaf2-4afc-a123-5361e18bb40d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:24.598613 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2efba8d9-aaf2-4afc-a123-5361e18bb40d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:24.783042 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-2efba8d9-aaf2-4afc-a123-5361e18bb40d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:24.795537 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-2efba8d9-aaf2-4afc-a123-5361e18bb40d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:24.802906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-2efba8d9-aaf2-4afc-a123-5361e18bb40d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:24.803407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f4a13729-a5cd-41b6-ab5a-add905a74f61 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:24.804169 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f4a13729-a5cd-41b6-ab5a-add905a74f61 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:24.804967 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-2efba8d9-aaf2-4afc-a123-5361e18bb40d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.223467 Aug 04 10:28:24.805554 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 233/499] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:24 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:24.824336 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f4a13729-a5cd-41b6-ab5a-add905a74f61 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:24.829356 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f4a13729-a5cd-41b6-ab5a-add905a74f61 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:24.830204 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f4a13729-a5cd-41b6-ab5a-add905a74f61 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:24.830537 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f4a13729-a5cd-41b6-ab5a-add905a74f61 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:25.024728 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f4a13729-a5cd-41b6-ab5a-add905a74f61 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:25.038705 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f4a13729-a5cd-41b6-ab5a-add905a74f61 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.235913 Aug 04 10:28:25.040860 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 267/500] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:24 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:28:25.834856 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4bc9609c-f7a9-4782-a058-fd84b4f0dee7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:25.835456 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4bc9609c-f7a9-4782-a058-fd84b4f0dee7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:25.850334 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4bc9609c-f7a9-4782-a058-fd84b4f0dee7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:25.850806 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4bc9609c-f7a9-4782-a058-fd84b4f0dee7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:25.851992 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4bc9609c-f7a9-4782-a058-fd84b4f0dee7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:25.852467 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4bc9609c-f7a9-4782-a058-fd84b4f0dee7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:26.017157 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4bc9609c-f7a9-4782-a058-fd84b4f0dee7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:26.033245 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4bc9609c-f7a9-4782-a058-fd84b4f0dee7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:26.035787 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4bc9609c-f7a9-4782-a058-fd84b4f0dee7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:26.037903 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4bc9609c-f7a9-4782-a058-fd84b4f0dee7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.206854 Aug 04 10:28:26.038723 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 234/501] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:25 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:26.064911 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-25588cfe-3bda-43d7-82e2-d1413c375309 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:26.066324 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-25588cfe-3bda-43d7-82e2-d1413c375309 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:26.073538 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-25588cfe-3bda-43d7-82e2-d1413c375309 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:26.074228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-25588cfe-3bda-43d7-82e2-d1413c375309 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:26.075008 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-25588cfe-3bda-43d7-82e2-d1413c375309 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:26.075460 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-25588cfe-3bda-43d7-82e2-d1413c375309 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:26.278372 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-25588cfe-3bda-43d7-82e2-d1413c375309 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:26.296648 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-25588cfe-3bda-43d7-82e2-d1413c375309 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.236161 Aug 04 10:28:26.300146 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 268/502] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:26 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:27.062560 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6096c003-4561-46a1-9412-ba6e254a0f93 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:27.063193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6096c003-4561-46a1-9412-ba6e254a0f93 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:27.069687 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6096c003-4561-46a1-9412-ba6e254a0f93 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:27.070134 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6096c003-4561-46a1-9412-ba6e254a0f93 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:27.070904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6096c003-4561-46a1-9412-ba6e254a0f93 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:27.071338 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6096c003-4561-46a1-9412-ba6e254a0f93 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:27.209435 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6096c003-4561-46a1-9412-ba6e254a0f93 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:27.218036 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6096c003-4561-46a1-9412-ba6e254a0f93 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:27.219548 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6096c003-4561-46a1-9412-ba6e254a0f93 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:27.220723 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6096c003-4561-46a1-9412-ba6e254a0f93 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.162795 Aug 04 10:28:27.221280 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 235/503] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:27 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:27.325309 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-74cbb97f-6ca4-4682-bf7b-37b188b6ab54 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:27.326281 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-74cbb97f-6ca4-4682-bf7b-37b188b6ab54 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:27.340258 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-74cbb97f-6ca4-4682-bf7b-37b188b6ab54 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:27.341104 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-74cbb97f-6ca4-4682-bf7b-37b188b6ab54 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:27.342194 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-74cbb97f-6ca4-4682-bf7b-37b188b6ab54 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:27.343144 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-74cbb97f-6ca4-4682-bf7b-37b188b6ab54 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:27.498661 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-74cbb97f-6ca4-4682-bf7b-37b188b6ab54 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:27.506722 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-74cbb97f-6ca4-4682-bf7b-37b188b6ab54 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.188640 Aug 04 10:28:27.507282 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 269/504] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:27 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:28.080866 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-364311965", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "networks": [{"uuid": "9886ce49-3a2d-4555-bb90-5ae2a85f5577"}]}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:28.146498 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.network.neutron [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] validate_networks() for [('9886ce49-3a2d-4555-bb90-5ae2a85f5577', None, None, None, None, None)] {{(pid=117667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:28:28.244751 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b2e6c6ff-a123-46ec-ab03-207c1af57aca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:28.246175 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b2e6c6ff-a123-46ec-ab03-207c1af57aca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:28.257998 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b2e6c6ff-a123-46ec-ab03-207c1af57aca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:28.258720 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b2e6c6ff-a123-46ec-ab03-207c1af57aca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:28.259651 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b2e6c6ff-a123-46ec-ab03-207c1af57aca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:28.260249 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b2e6c6ff-a123-46ec-ab03-207c1af57aca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:28.504487 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b2e6c6ff-a123-46ec-ab03-207c1af57aca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:28.513341 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b2e6c6ff-a123-46ec-ab03-207c1af57aca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:28.515376 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b2e6c6ff-a123-46ec-ab03-207c1af57aca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:28.517277 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b2e6c6ff-a123-46ec-ab03-207c1af57aca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.277265 Aug 04 10:28:28.517856 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 270/505] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:28 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:28:28.538751 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-64623d8e-28a8-460d-9f8a-8b48d94ed01d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:28.540004 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-64623d8e-28a8-460d-9f8a-8b48d94ed01d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:28.547272 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-64623d8e-28a8-460d-9f8a-8b48d94ed01d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:28.547646 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-64623d8e-28a8-460d-9f8a-8b48d94ed01d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:28.548658 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-64623d8e-28a8-460d-9f8a-8b48d94ed01d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:28.549370 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-64623d8e-28a8-460d-9f8a-8b48d94ed01d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:28.730279 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Flavor limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:28:28.730697 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Image limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:28:28.731160 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Flavor pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:28:28.731557 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Image pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:28:28.731979 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:28:28.741276 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:28.741715 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:28.742605 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:28.743171 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:28.750346 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-64623d8e-28a8-460d-9f8a-8b48d94ed01d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:28.758479 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-64623d8e-28a8-460d-9f8a-8b48d94ed01d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.225166 Aug 04 10:28:28.759410 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 271/506] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:28 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:28.770386 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Getting quotas for project 25fefc765ecb42728a941ddad185e082. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:28:28.775278 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Getting quotas for user f20047857e8c4e36a031813729c09a2b and project 25fefc765ecb42728a941ddad185e082. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:28:28.788177 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Going to run 1 instances... {{(pid=117667) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:28:28.790776 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:28:28.841540 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e41d9366-d288-4099-9c1a-f4f21e5bee30 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767340 Aug 04 10:28:28.842101 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 236/507] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:28:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:28:28.853358 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6268b01b-5b8c-47ef-95f8-c6fd47160e54 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:28.853961 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6268b01b-5b8c-47ef-95f8-c6fd47160e54 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:28.914194 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6268b01b-5b8c-47ef-95f8-c6fd47160e54 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:28.921411 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6268b01b-5b8c-47ef-95f8-c6fd47160e54 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1218 microversion: 2.1 time: 0.071693 Aug 04 10:28:28.928362 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 272/508] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:28 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:29.544482 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-2a976937-5140-4748-ae4d-2d92a80a9974 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:29.545203 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-2a976937-5140-4748-ae4d-2d92a80a9974 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:29.552485 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2a976937-5140-4748-ae4d-2d92a80a9974 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:29.552938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2a976937-5140-4748-ae4d-2d92a80a9974 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:29.553920 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2a976937-5140-4748-ae4d-2d92a80a9974 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:29.554370 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2a976937-5140-4748-ae4d-2d92a80a9974 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:29.695784 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-2a976937-5140-4748-ae4d-2d92a80a9974 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:29.707875 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-2a976937-5140-4748-ae4d-2d92a80a9974 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:29.710632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-2a976937-5140-4748-ae4d-2d92a80a9974 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:29.712220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-2a976937-5140-4748-ae4d-2d92a80a9974 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.172172 Aug 04 10:28:29.713469 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 237/509] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:29 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:29.780089 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d4fcd48e-5199-4a1d-ad93-b8cf56c18b77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:29.780832 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d4fcd48e-5199-4a1d-ad93-b8cf56c18b77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:29.787134 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d4fcd48e-5199-4a1d-ad93-b8cf56c18b77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:29.787585 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d4fcd48e-5199-4a1d-ad93-b8cf56c18b77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:29.788378 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d4fcd48e-5199-4a1d-ad93-b8cf56c18b77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:29.788814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d4fcd48e-5199-4a1d-ad93-b8cf56c18b77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:29.942775 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9a4fef21-3fac-4ed5-9214-fc0036ef5868 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:29.943387 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9a4fef21-3fac-4ed5-9214-fc0036ef5868 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:29.949469 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a4fef21-3fac-4ed5-9214-fc0036ef5868 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:29.949916 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a4fef21-3fac-4ed5-9214-fc0036ef5868 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:29.950681 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a4fef21-3fac-4ed5-9214-fc0036ef5868 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:29.951115 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a4fef21-3fac-4ed5-9214-fc0036ef5868 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:30.052123 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9a4fef21-3fac-4ed5-9214-fc0036ef5868 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:30.058180 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d4fcd48e-5199-4a1d-ad93-b8cf56c18b77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:30.059905 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9a4fef21-3fac-4ed5-9214-fc0036ef5868 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1222 microversion: 2.1 time: 0.120975 Aug 04 10:28:30.060590 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 238/510] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:29 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1222 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:28:30.065926 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d4fcd48e-5199-4a1d-ad93-b8cf56c18b77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.289682 Aug 04 10:28:30.066473 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 273/511] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:29 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:30.736650 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e8fca0ce-ab5f-4198-b83b-9ccd844c5f9d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:30.737414 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e8fca0ce-ab5f-4198-b83b-9ccd844c5f9d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:30.745571 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e8fca0ce-ab5f-4198-b83b-9ccd844c5f9d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:30.746080 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e8fca0ce-ab5f-4198-b83b-9ccd844c5f9d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:30.746854 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e8fca0ce-ab5f-4198-b83b-9ccd844c5f9d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:30.747286 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e8fca0ce-ab5f-4198-b83b-9ccd844c5f9d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:30.893366 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e8fca0ce-ab5f-4198-b83b-9ccd844c5f9d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:30.902687 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e8fca0ce-ab5f-4198-b83b-9ccd844c5f9d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:30.904218 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e8fca0ce-ab5f-4198-b83b-9ccd844c5f9d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:30.905558 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e8fca0ce-ab5f-4198-b83b-9ccd844c5f9d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.172690 Aug 04 10:28:30.906123 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 239/512] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:30 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:31.081210 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-70a1a901-6b13-41aa-8f85-7ff18385ec3c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:31.081828 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-70a1a901-6b13-41aa-8f85-7ff18385ec3c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:31.088679 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-283f3366-eb2c-4de4-a835-6cf948d6bec0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:31.089428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-283f3366-eb2c-4de4-a835-6cf948d6bec0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:31.090822 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-70a1a901-6b13-41aa-8f85-7ff18385ec3c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:31.091265 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-70a1a901-6b13-41aa-8f85-7ff18385ec3c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:31.092041 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-70a1a901-6b13-41aa-8f85-7ff18385ec3c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:31.092470 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-70a1a901-6b13-41aa-8f85-7ff18385ec3c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:31.095823 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-283f3366-eb2c-4de4-a835-6cf948d6bec0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:31.096304 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-283f3366-eb2c-4de4-a835-6cf948d6bec0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:31.097068 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-283f3366-eb2c-4de4-a835-6cf948d6bec0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:31.097546 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-283f3366-eb2c-4de4-a835-6cf948d6bec0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:31.101792 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=100 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:31.111403 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:31.394719 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-70a1a901-6b13-41aa-8f85-7ff18385ec3c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:31.402237 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-70a1a901-6b13-41aa-8f85-7ff18385ec3c tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1222 microversion: 2.1 time: 0.325057 Aug 04 10:28:31.402809 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 274/513] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:31 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1222 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:28:31.464224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-283f3366-eb2c-4de4-a835-6cf948d6bec0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:31.471669 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-283f3366-eb2c-4de4-a835-6cf948d6bec0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.387926 Aug 04 10:28:31.472270 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 240/514] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:31 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:28:31.928419 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2a628423-aaa4-4554-8679-52e33e517e84 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:31.929025 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2a628423-aaa4-4554-8679-52e33e517e84 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:31.935348 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a628423-aaa4-4554-8679-52e33e517e84 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:31.935792 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a628423-aaa4-4554-8679-52e33e517e84 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:31.937231 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a628423-aaa4-4554-8679-52e33e517e84 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:31.937668 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a628423-aaa4-4554-8679-52e33e517e84 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:32.064163 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2a628423-aaa4-4554-8679-52e33e517e84 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:32.072394 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2a628423-aaa4-4554-8679-52e33e517e84 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:32.073881 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2a628423-aaa4-4554-8679-52e33e517e84 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:32.075027 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2a628423-aaa4-4554-8679-52e33e517e84 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.150822 Aug 04 10:28:32.075590 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 275/515] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:31 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:32.423365 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-387ec053-1ad1-4bf0-a6c0-2f1162e24ac0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:32.424179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-387ec053-1ad1-4bf0-a6c0-2f1162e24ac0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:32.430804 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-387ec053-1ad1-4bf0-a6c0-2f1162e24ac0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:32.431255 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-387ec053-1ad1-4bf0-a6c0-2f1162e24ac0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:32.432050 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-387ec053-1ad1-4bf0-a6c0-2f1162e24ac0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:32.432493 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-387ec053-1ad1-4bf0-a6c0-2f1162e24ac0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:32.492216 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d7ad87f0-14b7-4678-83c2-3a155f6f803b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:32.492891 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d7ad87f0-14b7-4678-83c2-3a155f6f803b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:32.495356 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-387ec053-1ad1-4bf0-a6c0-2f1162e24ac0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:32.499813 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7ad87f0-14b7-4678-83c2-3a155f6f803b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:32.500319 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7ad87f0-14b7-4678-83c2-3a155f6f803b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:32.501103 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7ad87f0-14b7-4678-83c2-3a155f6f803b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:32.501954 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d7ad87f0-14b7-4678-83c2-3a155f6f803b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:32.502997 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-387ec053-1ad1-4bf0-a6c0-2f1162e24ac0 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1222 microversion: 2.1 time: 0.084295 Aug 04 10:28:32.503563 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 241/516] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:32 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:32.631752 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d7ad87f0-14b7-4678-83c2-3a155f6f803b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:32.639214 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d7ad87f0-14b7-4678-83c2-3a155f6f803b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.150928 Aug 04 10:28:32.640365 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 276/517] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:32 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:28:33.099184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e855920e-73b0-4302-915e-26a5b4a81587 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:33.099778 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e855920e-73b0-4302-915e-26a5b4a81587 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:33.105762 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e855920e-73b0-4302-915e-26a5b4a81587 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:33.106198 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e855920e-73b0-4302-915e-26a5b4a81587 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:33.106942 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e855920e-73b0-4302-915e-26a5b4a81587 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:33.107370 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e855920e-73b0-4302-915e-26a5b4a81587 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:33.237486 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e855920e-73b0-4302-915e-26a5b4a81587 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:33.246008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e855920e-73b0-4302-915e-26a5b4a81587 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:33.247587 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e855920e-73b0-4302-915e-26a5b4a81587 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:33.248763 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e855920e-73b0-4302-915e-26a5b4a81587 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.153589 Aug 04 10:28:33.249472 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 242/518] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:33 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:33.523850 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6469a942-0f15-46cc-a352-8b53a87d5e07 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:33.524553 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6469a942-0f15-46cc-a352-8b53a87d5e07 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:33.532890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6469a942-0f15-46cc-a352-8b53a87d5e07 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:33.533331 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6469a942-0f15-46cc-a352-8b53a87d5e07 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:33.534124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6469a942-0f15-46cc-a352-8b53a87d5e07 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:33.534553 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6469a942-0f15-46cc-a352-8b53a87d5e07 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:33.598732 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6469a942-0f15-46cc-a352-8b53a87d5e07 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:33.606269 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6469a942-0f15-46cc-a352-8b53a87d5e07 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1270 microversion: 2.1 time: 0.086369 Aug 04 10:28:33.606826 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 277/519] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:33 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:33.660444 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7f9e3a1f-58f5-432e-a0f1-a55ac18b3ece tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:33.661051 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7f9e3a1f-58f5-432e-a0f1-a55ac18b3ece tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:33.663354 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:33.669240 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7f9e3a1f-58f5-432e-a0f1-a55ac18b3ece tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:33.669687 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7f9e3a1f-58f5-432e-a0f1-a55ac18b3ece tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:33.670443 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7f9e3a1f-58f5-432e-a0f1-a55ac18b3ece tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:33.670877 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7f9e3a1f-58f5-432e-a0f1-a55ac18b3ece tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:33.805179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-7f9e3a1f-58f5-432e-a0f1-a55ac18b3ece tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:33.813148 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7f9e3a1f-58f5-432e-a0f1-a55ac18b3ece tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.156580 Aug 04 10:28:33.813710 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 243/520] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:33 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:34.271173 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-30528331-dea9-4792-825e-4d7071baf80a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:34.271778 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-30528331-dea9-4792-825e-4d7071baf80a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:34.279473 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30528331-dea9-4792-825e-4d7071baf80a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:34.279931 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30528331-dea9-4792-825e-4d7071baf80a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:34.280719 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30528331-dea9-4792-825e-4d7071baf80a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:34.281150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-30528331-dea9-4792-825e-4d7071baf80a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:34.423300 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-30528331-dea9-4792-825e-4d7071baf80a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:34.432036 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-30528331-dea9-4792-825e-4d7071baf80a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:34.433536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-30528331-dea9-4792-825e-4d7071baf80a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:34.434686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-30528331-dea9-4792-825e-4d7071baf80a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.167893 Aug 04 10:28:34.435241 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 278/521] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:34 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:34.626620 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e31446f3-8034-4d49-9d56-75b9e346f55b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:34.627222 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e31446f3-8034-4d49-9d56-75b9e346f55b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:34.633822 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e31446f3-8034-4d49-9d56-75b9e346f55b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:34.634258 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e31446f3-8034-4d49-9d56-75b9e346f55b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:34.635020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e31446f3-8034-4d49-9d56-75b9e346f55b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:34.635450 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e31446f3-8034-4d49-9d56-75b9e346f55b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:34.764291 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e31446f3-8034-4d49-9d56-75b9e346f55b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:34.772587 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e31446f3-8034-4d49-9d56-75b9e346f55b tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1318 microversion: 2.1 time: 0.149861 Aug 04 10:28:34.773158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 244/522] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:34 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:34.833665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8816dd33-c446-4f8e-9295-961ace553983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:34.834274 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8816dd33-c446-4f8e-9295-961ace553983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:34.840544 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8816dd33-c446-4f8e-9295-961ace553983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:34.840995 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8816dd33-c446-4f8e-9295-961ace553983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:34.841930 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8816dd33-c446-4f8e-9295-961ace553983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:34.842366 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8816dd33-c446-4f8e-9295-961ace553983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:34.973277 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8816dd33-c446-4f8e-9295-961ace553983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:34.980600 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8816dd33-c446-4f8e-9295-961ace553983 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.151016 Aug 04 10:28:34.981155 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 279/523] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:34 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:35.227003 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-e7b88d48-88ae-4044-a97e-a890cdf7a58c req-4abe55eb-4448-4d30-ba75-c94093e67258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5581514-f76e-4812-ac8a-8ed2befcbb3e", "tag": "7d784c14-cead-49fc-943b-03bac4cf8871"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:35.250676 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-e7b88d48-88ae-4044-a97e-a890cdf7a58c req-4abe55eb-4448-4d30-ba75-c94093e67258 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:35.251331 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-e7b88d48-88ae-4044-a97e-a890cdf7a58c req-4abe55eb-4448-4d30-ba75-c94093e67258 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:35.264443 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-e7b88d48-88ae-4044-a97e-a890cdf7a58c req-4abe55eb-4448-4d30-ba75-c94093e67258 service nova] Creating event network-changed:7d784c14-cead-49fc-943b-03bac4cf8871 for instance d5581514-f76e-4812-ac8a-8ed2befcbb3e on hv-cinder-82660 Aug 04 10:28:35.269665 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-e7b88d48-88ae-4044-a97e-a890cdf7a58c req-4abe55eb-4448-4d30-ba75-c94093e67258 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048199 Aug 04 10:28:35.270681 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 245/524] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:28:35.457102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-52104203-137f-4c39-934c-2d0782b9cd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:35.457727 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-52104203-137f-4c39-934c-2d0782b9cd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:35.464237 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-52104203-137f-4c39-934c-2d0782b9cd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:35.464690 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-52104203-137f-4c39-934c-2d0782b9cd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:35.466090 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-52104203-137f-4c39-934c-2d0782b9cd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:35.466526 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-52104203-137f-4c39-934c-2d0782b9cd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:35.561767 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-438567ce-a416-4561-af5b-07e34b91be07 req-7c6b1614-cae2-4d3a-a952-8473d5a60f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50c1eff-d3b4-4002-8596-abeba3280c3d", "name": "network-vif-plugged", "status": "completed", "tag": "36ab2e93-5e76-4e77-8112-8f585e52b695"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:35.575880 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-438567ce-a416-4561-af5b-07e34b91be07 req-7c6b1614-cae2-4d3a-a952-8473d5a60f24 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:35.576840 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-438567ce-a416-4561-af5b-07e34b91be07 req-7c6b1614-cae2-4d3a-a952-8473d5a60f24 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:35.595693 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-438567ce-a416-4561-af5b-07e34b91be07 req-7c6b1614-cae2-4d3a-a952-8473d5a60f24 service nova] Creating event network-vif-plugged:36ab2e93-5e76-4e77-8112-8f585e52b695 for instance a50c1eff-d3b4-4002-8596-abeba3280c3d on hv-cinder-82660 Aug 04 10:28:35.602332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-438567ce-a416-4561-af5b-07e34b91be07 req-7c6b1614-cae2-4d3a-a952-8473d5a60f24 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044516 Aug 04 10:28:35.604421 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 246/525] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:28:35.622727 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-52104203-137f-4c39-934c-2d0782b9cd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:35.632359 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-52104203-137f-4c39-934c-2d0782b9cd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:35.634144 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-52104203-137f-4c39-934c-2d0782b9cd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:35.636089 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-52104203-137f-4c39-934c-2d0782b9cd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.182905 Aug 04 10:28:35.637240 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 280/526] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:35 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:35.794810 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b199a16d-2642-47af-b507-be124d2fc69a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:35.795601 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b199a16d-2642-47af-b507-be124d2fc69a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:35.803338 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b199a16d-2642-47af-b507-be124d2fc69a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:35.803869 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b199a16d-2642-47af-b507-be124d2fc69a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:35.804718 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b199a16d-2642-47af-b507-be124d2fc69a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:35.805239 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b199a16d-2642-47af-b507-be124d2fc69a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:35.940386 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b199a16d-2642-47af-b507-be124d2fc69a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:35.947705 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b199a16d-2642-47af-b507-be124d2fc69a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1318 microversion: 2.1 time: 0.157737 Aug 04 10:28:35.948298 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 247/527] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:35 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:36.000743 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4d0b9d68-ed94-4fd2-a28f-3258e0704d19 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:36.001345 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4d0b9d68-ed94-4fd2-a28f-3258e0704d19 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:36.007287 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4d0b9d68-ed94-4fd2-a28f-3258e0704d19 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:36.007734 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4d0b9d68-ed94-4fd2-a28f-3258e0704d19 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:36.008521 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4d0b9d68-ed94-4fd2-a28f-3258e0704d19 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:36.008955 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4d0b9d68-ed94-4fd2-a28f-3258e0704d19 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:36.141156 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4d0b9d68-ed94-4fd2-a28f-3258e0704d19 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:36.148685 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4d0b9d68-ed94-4fd2-a28f-3258e0704d19 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.151668 Aug 04 10:28:36.149224 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 281/528] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:35 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:36.659284 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d1b9601e-2ace-4ec3-be1b-feb548f240a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:36.659878 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-d1b9601e-2ace-4ec3-be1b-feb548f240a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:36.666000 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d1b9601e-2ace-4ec3-be1b-feb548f240a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:36.666439 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d1b9601e-2ace-4ec3-be1b-feb548f240a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:36.667185 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d1b9601e-2ace-4ec3-be1b-feb548f240a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:36.667610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d1b9601e-2ace-4ec3-be1b-feb548f240a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:36.794920 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d1b9601e-2ace-4ec3-be1b-feb548f240a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:36.804145 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d1b9601e-2ace-4ec3-be1b-feb548f240a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:36.805807 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d1b9601e-2ace-4ec3-be1b-feb548f240a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:36.806935 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d1b9601e-2ace-4ec3-be1b-feb548f240a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.151994 Aug 04 10:28:36.807479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 248/529] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:36 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:36.968360 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4c0cf6a7-b8fe-439a-931d-2ef37de4879a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:36.968895 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4c0cf6a7-b8fe-439a-931d-2ef37de4879a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:36.975448 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4c0cf6a7-b8fe-439a-931d-2ef37de4879a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:36.975893 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4c0cf6a7-b8fe-439a-931d-2ef37de4879a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:36.976766 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4c0cf6a7-b8fe-439a-931d-2ef37de4879a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:36.977197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4c0cf6a7-b8fe-439a-931d-2ef37de4879a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:37.112348 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4c0cf6a7-b8fe-439a-931d-2ef37de4879a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:37.120192 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4c0cf6a7-b8fe-439a-931d-2ef37de4879a tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1318 microversion: 2.1 time: 0.156214 Aug 04 10:28:37.120768 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 282/530] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:36 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:37.169922 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f1888893-e603-4827-a088-16e5f5d9d65a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:37.170840 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f1888893-e603-4827-a088-16e5f5d9d65a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:37.177283 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f1888893-e603-4827-a088-16e5f5d9d65a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:37.177726 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f1888893-e603-4827-a088-16e5f5d9d65a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:37.178504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f1888893-e603-4827-a088-16e5f5d9d65a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:37.178937 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f1888893-e603-4827-a088-16e5f5d9d65a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:37.312992 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f1888893-e603-4827-a088-16e5f5d9d65a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:37.320565 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f1888893-e603-4827-a088-16e5f5d9d65a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.154673 Aug 04 10:28:37.321123 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 249/531] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:37 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:37.829661 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f2d00a27-4368-4b17-b0a9-c4dd0ffd0c1a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:37.830296 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f2d00a27-4368-4b17-b0a9-c4dd0ffd0c1a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:37.836453 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f2d00a27-4368-4b17-b0a9-c4dd0ffd0c1a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:37.836903 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f2d00a27-4368-4b17-b0a9-c4dd0ffd0c1a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:37.837664 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f2d00a27-4368-4b17-b0a9-c4dd0ffd0c1a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:37.838097 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f2d00a27-4368-4b17-b0a9-c4dd0ffd0c1a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:37.971233 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f2d00a27-4368-4b17-b0a9-c4dd0ffd0c1a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:37.980272 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f2d00a27-4368-4b17-b0a9-c4dd0ffd0c1a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:37.981764 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f2d00a27-4368-4b17-b0a9-c4dd0ffd0c1a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:37.982900 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f2d00a27-4368-4b17-b0a9-c4dd0ffd0c1a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.157282 Aug 04 10:28:37.983937 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 283/532] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:37 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:38.140698 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ea4372e0-c345-404f-a6dc-0b15f28388db tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:38.141359 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ea4372e0-c345-404f-a6dc-0b15f28388db tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:38.147930 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ea4372e0-c345-404f-a6dc-0b15f28388db tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:38.148396 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ea4372e0-c345-404f-a6dc-0b15f28388db tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:38.149152 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ea4372e0-c345-404f-a6dc-0b15f28388db tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:38.149578 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ea4372e0-c345-404f-a6dc-0b15f28388db tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:38.279833 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-ea4372e0-c345-404f-a6dc-0b15f28388db tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:38.287829 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ea4372e0-c345-404f-a6dc-0b15f28388db tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1318 microversion: 2.1 time: 0.151028 Aug 04 10:28:38.288433 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 250/533] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:38 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:38.341825 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2d778ffd-870f-47f3-b58b-4052fb57530c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:38.342474 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2d778ffd-870f-47f3-b58b-4052fb57530c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:38.349087 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d778ffd-870f-47f3-b58b-4052fb57530c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:38.349537 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d778ffd-870f-47f3-b58b-4052fb57530c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:38.350293 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d778ffd-870f-47f3-b58b-4052fb57530c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:38.350731 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2d778ffd-870f-47f3-b58b-4052fb57530c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:38.486526 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2d778ffd-870f-47f3-b58b-4052fb57530c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:38.493891 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2d778ffd-870f-47f3-b58b-4052fb57530c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1266 microversion: 2.1 time: 0.155925 Aug 04 10:28:38.494449 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 284/534] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:38 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:39.005835 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-58bad11e-4ece-414f-af7a-b6f0a54eade7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:39.006480 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-58bad11e-4ece-414f-af7a-b6f0a54eade7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:39.008460 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:39.009113 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=6 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:39.015793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-58bad11e-4ece-414f-af7a-b6f0a54eade7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:39.016267 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-58bad11e-4ece-414f-af7a-b6f0a54eade7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:39.017028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-58bad11e-4ece-414f-af7a-b6f0a54eade7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:39.017461 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-58bad11e-4ece-414f-af7a-b6f0a54eade7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:39.150460 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-58bad11e-4ece-414f-af7a-b6f0a54eade7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:39.158858 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-58bad11e-4ece-414f-af7a-b6f0a54eade7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:39.160570 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-58bad11e-4ece-414f-af7a-b6f0a54eade7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:39.161731 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-58bad11e-4ece-414f-af7a-b6f0a54eade7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.159827 Aug 04 10:28:39.162300 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 251/535] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:39 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:39.310999 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6830687c-318b-4051-9d72-9e6b22a29ab3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:39.312248 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6830687c-318b-4051-9d72-9e6b22a29ab3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:39.314123 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:39.321191 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6830687c-318b-4051-9d72-9e6b22a29ab3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:39.321642 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6830687c-318b-4051-9d72-9e6b22a29ab3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:39.322408 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6830687c-318b-4051-9d72-9e6b22a29ab3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:39.322844 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6830687c-318b-4051-9d72-9e6b22a29ab3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:39.452476 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6830687c-318b-4051-9d72-9e6b22a29ab3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:39.460257 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6830687c-318b-4051-9d72-9e6b22a29ab3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1318 microversion: 2.1 time: 0.153918 Aug 04 10:28:39.460833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 285/536] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:39 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:39.513916 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8dd45fc5-c0b9-4eb1-9eb7-1ce8c2fb9dea tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:39.514558 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8dd45fc5-c0b9-4eb1-9eb7-1ce8c2fb9dea tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:39.520530 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8dd45fc5-c0b9-4eb1-9eb7-1ce8c2fb9dea tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:39.520984 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8dd45fc5-c0b9-4eb1-9eb7-1ce8c2fb9dea tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:39.521750 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8dd45fc5-c0b9-4eb1-9eb7-1ce8c2fb9dea tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:39.522188 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8dd45fc5-c0b9-4eb1-9eb7-1ce8c2fb9dea tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:39.587275 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-b1110846-ad00-4382-ae78-3450194baf07 req-3f9799dc-c9b4-492c-babc-c7e5177a93e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5581514-f76e-4812-ac8a-8ed2befcbb3e", "name": "network-vif-plugged", "status": "completed", "tag": "7d784c14-cead-49fc-943b-03bac4cf8871"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:39.598848 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-b1110846-ad00-4382-ae78-3450194baf07 req-3f9799dc-c9b4-492c-babc-c7e5177a93e4 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:39.599398 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-b1110846-ad00-4382-ae78-3450194baf07 req-3f9799dc-c9b4-492c-babc-c7e5177a93e4 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:39.615830 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-b1110846-ad00-4382-ae78-3450194baf07 req-3f9799dc-c9b4-492c-babc-c7e5177a93e4 service nova] Creating event network-vif-plugged:7d784c14-cead-49fc-943b-03bac4cf8871 for instance d5581514-f76e-4812-ac8a-8ed2befcbb3e on hv-cinder-82660 Aug 04 10:28:39.620891 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-b1110846-ad00-4382-ae78-3450194baf07 req-3f9799dc-c9b4-492c-babc-c7e5177a93e4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037374 Aug 04 10:28:39.621504 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 286/537] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:28:39.665955 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8dd45fc5-c0b9-4eb1-9eb7-1ce8c2fb9dea tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:39.674766 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8dd45fc5-c0b9-4eb1-9eb7-1ce8c2fb9dea tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1454 microversion: 2.1 time: 0.165103 Aug 04 10:28:39.675352 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 252/538] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:39 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:39.696506 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e3ca6921-42ff-4842-88b0-67b200d8cac7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:39.697187 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e3ca6921-42ff-4842-88b0-67b200d8cac7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:39.703409 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e3ca6921-42ff-4842-88b0-67b200d8cac7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:39.703853 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e3ca6921-42ff-4842-88b0-67b200d8cac7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:39.704627 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e3ca6921-42ff-4842-88b0-67b200d8cac7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:39.705054 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e3ca6921-42ff-4842-88b0-67b200d8cac7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:39.835319 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e3ca6921-42ff-4842-88b0-67b200d8cac7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:39.843338 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e3ca6921-42ff-4842-88b0-67b200d8cac7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1454 microversion: 2.1 time: 0.150590 Aug 04 10:28:39.843894 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 287/539] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:39 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:40.184953 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c2dcdd18-8b09-4a74-b8c8-e0e9930986b6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:40.185531 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c2dcdd18-8b09-4a74-b8c8-e0e9930986b6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:40.192010 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c2dcdd18-8b09-4a74-b8c8-e0e9930986b6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:40.192470 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c2dcdd18-8b09-4a74-b8c8-e0e9930986b6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:40.193226 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c2dcdd18-8b09-4a74-b8c8-e0e9930986b6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:40.193653 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c2dcdd18-8b09-4a74-b8c8-e0e9930986b6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:40.417066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c2dcdd18-8b09-4a74-b8c8-e0e9930986b6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:40.426418 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c2dcdd18-8b09-4a74-b8c8-e0e9930986b6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:40.428289 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c2dcdd18-8b09-4a74-b8c8-e0e9930986b6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:40.429504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c2dcdd18-8b09-4a74-b8c8-e0e9930986b6 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.248451 Aug 04 10:28:40.430258 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 253/540] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:40 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:40.480008 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-70683a78-ccd0-4b63-a464-c00438fb3440 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:40.480671 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-70683a78-ccd0-4b63-a464-c00438fb3440 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:40.487738 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-70683a78-ccd0-4b63-a464-c00438fb3440 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:40.488226 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-70683a78-ccd0-4b63-a464-c00438fb3440 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:40.489001 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-70683a78-ccd0-4b63-a464-c00438fb3440 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:40.489441 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-70683a78-ccd0-4b63-a464-c00438fb3440 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:40.727217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-70683a78-ccd0-4b63-a464-c00438fb3440 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:40.736139 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-70683a78-ccd0-4b63-a464-c00438fb3440 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1318 microversion: 2.1 time: 0.259889 Aug 04 10:28:40.737454 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 288/541] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:40 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:41.453000 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c47407c7-01b3-48e4-b8c8-b900e90e9bdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:41.453550 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c47407c7-01b3-48e4-b8c8-b900e90e9bdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:41.459893 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c47407c7-01b3-48e4-b8c8-b900e90e9bdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:41.460363 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c47407c7-01b3-48e4-b8c8-b900e90e9bdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:41.461217 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c47407c7-01b3-48e4-b8c8-b900e90e9bdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:41.461643 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c47407c7-01b3-48e4-b8c8-b900e90e9bdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:41.651220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c47407c7-01b3-48e4-b8c8-b900e90e9bdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:41.660438 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c47407c7-01b3-48e4-b8c8-b900e90e9bdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:41.662044 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c47407c7-01b3-48e4-b8c8-b900e90e9bdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:41.663200 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c47407c7-01b3-48e4-b8c8-b900e90e9bdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.214208 Aug 04 10:28:41.663760 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 254/542] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:41 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:41.757749 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-11f81479-a01d-48d5-a9ae-f85e0563326e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:41.758583 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-11f81479-a01d-48d5-a9ae-f85e0563326e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:41.765968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11f81479-a01d-48d5-a9ae-f85e0563326e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:41.766338 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11f81479-a01d-48d5-a9ae-f85e0563326e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:41.767497 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11f81479-a01d-48d5-a9ae-f85e0563326e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:41.767932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11f81479-a01d-48d5-a9ae-f85e0563326e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:41.813529 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-c5e14ae3-b3af-4617-8ab5-a67a785e1fc0 req-5ec62c25-5963-435a-8c87-9f3989dba132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50c1eff-d3b4-4002-8596-abeba3280c3d", "tag": "36ab2e93-5e76-4e77-8112-8f585e52b695"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:41.826901 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-c5e14ae3-b3af-4617-8ab5-a67a785e1fc0 req-5ec62c25-5963-435a-8c87-9f3989dba132 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:41.828020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-c5e14ae3-b3af-4617-8ab5-a67a785e1fc0 req-5ec62c25-5963-435a-8c87-9f3989dba132 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:41.841531 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-c5e14ae3-b3af-4617-8ab5-a67a785e1fc0 req-5ec62c25-5963-435a-8c87-9f3989dba132 service nova] Creating event network-changed:36ab2e93-5e76-4e77-8112-8f585e52b695 for instance a50c1eff-d3b4-4002-8596-abeba3280c3d on hv-cinder-82660 Aug 04 10:28:41.847620 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-c5e14ae3-b3af-4617-8ab5-a67a785e1fc0 req-5ec62c25-5963-435a-8c87-9f3989dba132 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040380 Aug 04 10:28:41.848591 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 255/543] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:28:41.913563 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-11f81479-a01d-48d5-a9ae-f85e0563326e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:41.920980 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-11f81479-a01d-48d5-a9ae-f85e0563326e tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1318 microversion: 2.1 time: 0.167096 Aug 04 10:28:41.921548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 289/544] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:41 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:42.688210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-566b9266-ad57-4ac0-8cbe-648b1468aca2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:42.688892 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-566b9266-ad57-4ac0-8cbe-648b1468aca2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:42.696989 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-566b9266-ad57-4ac0-8cbe-648b1468aca2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:42.697435 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-566b9266-ad57-4ac0-8cbe-648b1468aca2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:42.698194 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-566b9266-ad57-4ac0-8cbe-648b1468aca2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:42.698623 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-566b9266-ad57-4ac0-8cbe-648b1468aca2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:42.835089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-566b9266-ad57-4ac0-8cbe-648b1468aca2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:42.844114 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-566b9266-ad57-4ac0-8cbe-648b1468aca2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:42.845615 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-566b9266-ad57-4ac0-8cbe-648b1468aca2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:42.846767 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-566b9266-ad57-4ac0-8cbe-648b1468aca2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.163906 Aug 04 10:28:42.847328 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 256/545] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:42 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:42.941737 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-96d919dc-0cc9-4847-8605-65bc86a54384 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:42.942345 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-96d919dc-0cc9-4847-8605-65bc86a54384 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:42.949099 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96d919dc-0cc9-4847-8605-65bc86a54384 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:42.949545 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96d919dc-0cc9-4847-8605-65bc86a54384 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:42.950313 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96d919dc-0cc9-4847-8605-65bc86a54384 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:42.950773 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-96d919dc-0cc9-4847-8605-65bc86a54384 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:43.091601 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-96d919dc-0cc9-4847-8605-65bc86a54384 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:43.099679 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-96d919dc-0cc9-4847-8605-65bc86a54384 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1507 microversion: 2.1 time: 0.161799 Aug 04 10:28:43.100286 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 290/546] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:42 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:43.119933 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8cd4f038-b622-4f03-a229-b1ff98b7dfad tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3670dbc-6f58-40fa-be3a-c4c799474f7a", "device": "/dev/sdb"}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:43.123266 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8cd4f038-b622-4f03-a229-b1ff98b7dfad tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:43.129442 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8cd4f038-b622-4f03-a229-b1ff98b7dfad tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:43.129882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8cd4f038-b622-4f03-a229-b1ff98b7dfad tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:43.130664 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8cd4f038-b622-4f03-a229-b1ff98b7dfad tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:43.131283 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8cd4f038-b622-4f03-a229-b1ff98b7dfad tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:43.371456 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:43.396247 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8cd4f038-b622-4f03-a229-b1ff98b7dfad tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "POST /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280298 Aug 04 10:28:43.397024 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 257/547] 10.222.0.72 () {60 vars in 1323 bytes} [Thu Aug 4 10:28:43 2022] POST /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:28:43.870178 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7ae7d94c-0ebc-4f7c-9b41-1b49a639ce31 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:43.870785 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7ae7d94c-0ebc-4f7c-9b41-1b49a639ce31 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:43.877030 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ae7d94c-0ebc-4f7c-9b41-1b49a639ce31 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:43.877485 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ae7d94c-0ebc-4f7c-9b41-1b49a639ce31 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:43.878289 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ae7d94c-0ebc-4f7c-9b41-1b49a639ce31 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:43.878720 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7ae7d94c-0ebc-4f7c-9b41-1b49a639ce31 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:44.013168 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7ae7d94c-0ebc-4f7c-9b41-1b49a639ce31 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:44.016138 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:44.023407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7ae7d94c-0ebc-4f7c-9b41-1b49a639ce31 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:44.024953 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7ae7d94c-0ebc-4f7c-9b41-1b49a639ce31 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:44.026133 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7ae7d94c-0ebc-4f7c-9b41-1b49a639ce31 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.159979 Aug 04 10:28:44.026692 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 291/548] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:43 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:45.052064 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7bac283f-3e99-4b74-8ccb-bd9d250f46c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:45.052746 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7bac283f-3e99-4b74-8ccb-bd9d250f46c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:45.059036 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7bac283f-3e99-4b74-8ccb-bd9d250f46c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:45.059480 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7bac283f-3e99-4b74-8ccb-bd9d250f46c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:45.060282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7bac283f-3e99-4b74-8ccb-bd9d250f46c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:45.060716 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7bac283f-3e99-4b74-8ccb-bd9d250f46c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:45.193109 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-7bac283f-3e99-4b74-8ccb-bd9d250f46c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:45.201624 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-7bac283f-3e99-4b74-8ccb-bd9d250f46c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:45.203122 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-7bac283f-3e99-4b74-8ccb-bd9d250f46c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:45.204299 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7bac283f-3e99-4b74-8ccb-bd9d250f46c5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.157301 Aug 04 10:28:45.204864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 258/549] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:45 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:45.638494 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-1a214c01-f1ff-45af-8c8a-733dcf98c194 req-5f62bc62-1d0e-401e-88db-3faf323f945d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0396f5e6-1b64-4b0f-9352-28165af5878b", "name": "network-vif-plugged", "status": "completed", "tag": "46e7bd28-a5a1-4c48-aa21-1a4902096c91"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:45.649768 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-1a214c01-f1ff-45af-8c8a-733dcf98c194 req-5f62bc62-1d0e-401e-88db-3faf323f945d service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:45.650215 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-1a214c01-f1ff-45af-8c8a-733dcf98c194 req-5f62bc62-1d0e-401e-88db-3faf323f945d service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:45.661457 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-1a214c01-f1ff-45af-8c8a-733dcf98c194 req-5f62bc62-1d0e-401e-88db-3faf323f945d service nova] Creating event network-vif-plugged:46e7bd28-a5a1-4c48-aa21-1a4902096c91 for instance 0396f5e6-1b64-4b0f-9352-28165af5878b on hv-cinder-82660 Aug 04 10:28:45.666339 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-1a214c01-f1ff-45af-8c8a-733dcf98c194 req-5f62bc62-1d0e-401e-88db-3faf323f945d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032140 Aug 04 10:28:45.667085 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 292/550] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:28:46.227178 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-84819aa1-aea1-4e32-90e0-d0dc63556ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:46.227705 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-84819aa1-aea1-4e32-90e0-d0dc63556ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:46.234129 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-84819aa1-aea1-4e32-90e0-d0dc63556ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:46.235647 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-84819aa1-aea1-4e32-90e0-d0dc63556ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:46.236518 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-84819aa1-aea1-4e32-90e0-d0dc63556ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:46.236954 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-84819aa1-aea1-4e32-90e0-d0dc63556ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:46.370678 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-84819aa1-aea1-4e32-90e0-d0dc63556ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:46.378999 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-84819aa1-aea1-4e32-90e0-d0dc63556ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:46.380601 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-84819aa1-aea1-4e32-90e0-d0dc63556ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:46.381747 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-84819aa1-aea1-4e32-90e0-d0dc63556ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.158637 Aug 04 10:28:46.382300 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 259/551] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:46 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:47.405402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6716d5a2-15fd-4ceb-99ad-73c5b5eb1e9b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:47.406108 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6716d5a2-15fd-4ceb-99ad-73c5b5eb1e9b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:47.408080 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=73 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:47.413978 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6716d5a2-15fd-4ceb-99ad-73c5b5eb1e9b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:47.414425 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6716d5a2-15fd-4ceb-99ad-73c5b5eb1e9b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:47.415182 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6716d5a2-15fd-4ceb-99ad-73c5b5eb1e9b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:47.415617 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6716d5a2-15fd-4ceb-99ad-73c5b5eb1e9b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:47.545090 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6716d5a2-15fd-4ceb-99ad-73c5b5eb1e9b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:47.554380 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6716d5a2-15fd-4ceb-99ad-73c5b5eb1e9b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:47.556023 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6716d5a2-15fd-4ceb-99ad-73c5b5eb1e9b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:47.557162 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6716d5a2-15fd-4ceb-99ad-73c5b5eb1e9b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.156572 Aug 04 10:28:47.557714 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 293/552] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:47 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:48.580542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-22a8eb29-9657-426b-b32d-8931b7db3492 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:48.581136 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-22a8eb29-9657-426b-b32d-8931b7db3492 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:48.587747 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-22a8eb29-9657-426b-b32d-8931b7db3492 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:48.588229 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-22a8eb29-9657-426b-b32d-8931b7db3492 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:48.588994 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-22a8eb29-9657-426b-b32d-8931b7db3492 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:48.589433 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-22a8eb29-9657-426b-b32d-8931b7db3492 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:48.719931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-22a8eb29-9657-426b-b32d-8931b7db3492 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:48.728532 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-22a8eb29-9657-426b-b32d-8931b7db3492 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:48.730023 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-22a8eb29-9657-426b-b32d-8931b7db3492 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:48.731170 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-22a8eb29-9657-426b-b32d-8931b7db3492 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.154694 Aug 04 10:28:48.731721 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 260/553] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:48 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:49.754156 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b19f649e-376c-4ee1-aac8-6c9fc58b3f98 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:49.754780 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b19f649e-376c-4ee1-aac8-6c9fc58b3f98 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:49.761621 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b19f649e-376c-4ee1-aac8-6c9fc58b3f98 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:49.762069 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b19f649e-376c-4ee1-aac8-6c9fc58b3f98 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:49.762856 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b19f649e-376c-4ee1-aac8-6c9fc58b3f98 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:49.763431 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b19f649e-376c-4ee1-aac8-6c9fc58b3f98 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:49.895222 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b19f649e-376c-4ee1-aac8-6c9fc58b3f98 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:49.903569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b19f649e-376c-4ee1-aac8-6c9fc58b3f98 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:49.905097 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b19f649e-376c-4ee1-aac8-6c9fc58b3f98 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:49.906236 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b19f649e-376c-4ee1-aac8-6c9fc58b3f98 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.156049 Aug 04 10:28:49.907493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 294/554] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:49 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:50.930042 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f4d7972a-8096-4091-97d8-1263a14a8825 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:50.930678 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f4d7972a-8096-4091-97d8-1263a14a8825 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:50.937370 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f4d7972a-8096-4091-97d8-1263a14a8825 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:50.937816 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f4d7972a-8096-4091-97d8-1263a14a8825 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:50.938567 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f4d7972a-8096-4091-97d8-1263a14a8825 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:50.938998 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f4d7972a-8096-4091-97d8-1263a14a8825 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:51.069731 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f4d7972a-8096-4091-97d8-1263a14a8825 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:51.079805 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f4d7972a-8096-4091-97d8-1263a14a8825 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:51.081618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f4d7972a-8096-4091-97d8-1263a14a8825 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:51.083064 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f4d7972a-8096-4091-97d8-1263a14a8825 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1809 microversion: 2.20 time: 0.156837 Aug 04 10:28:51.083859 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 261/555] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:50 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:52.107277 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9efa1a6c-7bca-4f80-8410-029a0c12ccbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:52.108094 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9efa1a6c-7bca-4f80-8410-029a0c12ccbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:52.115767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9efa1a6c-7bca-4f80-8410-029a0c12ccbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:52.116244 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9efa1a6c-7bca-4f80-8410-029a0c12ccbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:52.117117 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9efa1a6c-7bca-4f80-8410-029a0c12ccbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:52.117634 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9efa1a6c-7bca-4f80-8410-029a0c12ccbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:52.246720 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9efa1a6c-7bca-4f80-8410-029a0c12ccbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:52.260963 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9efa1a6c-7bca-4f80-8410-029a0c12ccbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:52.262481 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9efa1a6c-7bca-4f80-8410-029a0c12ccbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:52.263627 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9efa1a6c-7bca-4f80-8410-029a0c12ccbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1796 microversion: 2.20 time: 0.160629 Aug 04 10:28:52.264210 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 295/556] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:28:52 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1796 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:28:52.458060 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-371cf963-7a90-4c18-8a99-91308dc02db6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:52.458578 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-371cf963-7a90-4c18-8a99-91308dc02db6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:52.465023 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-371cf963-7a90-4c18-8a99-91308dc02db6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:52.465469 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-371cf963-7a90-4c18-8a99-91308dc02db6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:52.466221 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-371cf963-7a90-4c18-8a99-91308dc02db6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:52.466651 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-371cf963-7a90-4c18-8a99-91308dc02db6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:52.490082 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-371cf963-7a90-4c18-8a99-91308dc02db6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653/ips" status: 200 len: 150 microversion: 2.1 time: 0.035991 Aug 04 10:28:52.490642 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 262/557] 10.222.0.72 () {58 vars in 1248 bytes} [Thu Aug 4 10:28:52 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:28:52.503020 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ba90b87f-3b59-46da-a6d5-43873aa00c46 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd5080ab-4aa1-4813-be6b-ccbf6b2cfa41"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:28:52.505378 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ba90b87f-3b59-46da-a6d5-43873aa00c46 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:52.511296 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba90b87f-3b59-46da-a6d5-43873aa00c46 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:52.511735 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba90b87f-3b59-46da-a6d5-43873aa00c46 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:52.512517 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba90b87f-3b59-46da-a6d5-43873aa00c46 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:52.512938 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ba90b87f-3b59-46da-a6d5-43873aa00c46 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:52.593787 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-ba90b87f-3b59-46da-a6d5-43873aa00c46 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] HTTP exception thrown: Invalid volume: volume cd5080ab-4aa1-4813-be6b-ccbf6b2cfa41 is already attached to instances: 1d55a58c-f47e-4284-9ffa-f7fb642845fb Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ba90b87f-3b59-46da-a6d5-43873aa00c46 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Request method failure captured: Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: POST /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653/os-volume_attachments HTTP/1.1 Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 74 Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656Tob97WbD_ZS5F2g-QN7pC61pEa9bei56wET8TrZeizeYQWOy31gmFZi3BtMbEG-sSRMiaAjSOk7-SIrWX3R_-R1F1qjTprnkQ7VwtSLuza02D0xNMbtZfy2jBcBSsmOWIl7uTSBWVqK40vdniduqG7S6ibX_f6b3y_2MqFav-ZhA Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:28:52.596034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:28:52.597567 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:28:52.597567 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:28:52.597567 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:28:52.597567 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:28:52.597567 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:28:52.597567 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:28:52.597567 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:28:52.597567 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: b680411b142642b7acc3585d2481f880 Aug 04 10:28:52.597567 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:28:52.597567 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Aug 04 10:28:52.597567 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {"volumeAttachment": {"volumeId": "cd5080ab-4aa1-4813-be6b-ccbf6b2cfa41"}} Aug 04 10:28:52.597567 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Invalid volume: volume cd5080ab-4aa1-4813-be6b-ccbf6b2cfa41 is already attached to instances: 1d55a58c-f47e-4284-9ffa-f7fb642845fb Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'server_id': '323e8a06-ea21-43a6-a575-4973b1616653', 'body': {'volumeAttachment': {'volumeId': 'cd5080ab-4aa1-4813-be6b-ccbf6b2cfa41'}}} Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cd5080ab-4aa1-4813-be6b-ccbf6b2cfa41 is already attached to instances: 1d55a58c-f47e-4284-9ffa-f7fb642845fb Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:28:52.598480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cd5080ab-4aa1-4813-be6b-ccbf6b2cfa41 is already attached to instances: 1d55a58c-f47e-4284-9ffa-f7fb642845fb Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:28:52.599885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:28:52.601371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:28:52.601371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:28:52.601371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:28:52.601371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cd5080ab-4aa1-4813-be6b-ccbf6b2cfa41 is already attached to instances: 1d55a58c-f47e-4284-9ffa-f7fb642845fb Aug 04 10:28:52.601371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:28:52.601371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ba90b87f-3b59-46da-a6d5-43873aa00c46 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Returning 400 to user: Invalid volume: volume cd5080ab-4aa1-4813-be6b-ccbf6b2cfa41 is already attached to instances: 1d55a58c-f47e-4284-9ffa-f7fb642845fb {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:28:52.601371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ba90b87f-3b59-46da-a6d5-43873aa00c46 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "POST /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098557 Aug 04 10:28:52.601371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 296/558] 10.222.0.72 () {60 vars in 1323 bytes} [Thu Aug 4 10:28:52 2022] POST /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:28:52.606444 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f8559f85-b5dd-417f-8ab5-b1863a9cbb75 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:52.606935 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f8559f85-b5dd-417f-8ab5-b1863a9cbb75 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:52.613828 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f8559f85-b5dd-417f-8ab5-b1863a9cbb75 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:52.614276 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f8559f85-b5dd-417f-8ab5-b1863a9cbb75 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:52.615074 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f8559f85-b5dd-417f-8ab5-b1863a9cbb75 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:52.615509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f8559f85-b5dd-417f-8ab5-b1863a9cbb75 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:52.639627 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f8559f85-b5dd-417f-8ab5-b1863a9cbb75 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Going to try to terminate instance {{(pid=117667) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:28:52.713364 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f8559f85-b5dd-417f-8ab5-b1863a9cbb75 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 204 len: 0 microversion: 2.1 time: 0.110410 Aug 04 10:28:52.713863 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 263/559] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:28:52 2022] DELETE /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:28:52.722872 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0f2556f5-f37c-4041-b4c2-a9e58e002659 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:52.723454 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0f2556f5-f37c-4041-b4c2-a9e58e002659 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:52.730851 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0f2556f5-f37c-4041-b4c2-a9e58e002659 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:52.731501 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0f2556f5-f37c-4041-b4c2-a9e58e002659 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:52.732643 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0f2556f5-f37c-4041-b4c2-a9e58e002659 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:52.733084 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0f2556f5-f37c-4041-b4c2-a9e58e002659 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:52.858897 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0f2556f5-f37c-4041-b4c2-a9e58e002659 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:52.866550 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0f2556f5-f37c-4041-b4c2-a9e58e002659 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1681 microversion: 2.1 time: 0.148355 Aug 04 10:28:52.867116 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 297/560] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:52 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:53.888054 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0cad196a-bf6d-4ab7-9fa1-9af5cb07f97a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:53.888755 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0cad196a-bf6d-4ab7-9fa1-9af5cb07f97a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:53.895258 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0cad196a-bf6d-4ab7-9fa1-9af5cb07f97a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:53.895715 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0cad196a-bf6d-4ab7-9fa1-9af5cb07f97a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:53.896505 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0cad196a-bf6d-4ab7-9fa1-9af5cb07f97a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:53.896939 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0cad196a-bf6d-4ab7-9fa1-9af5cb07f97a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:54.030100 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0cad196a-bf6d-4ab7-9fa1-9af5cb07f97a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:54.038230 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0cad196a-bf6d-4ab7-9fa1-9af5cb07f97a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1681 microversion: 2.1 time: 0.154403 Aug 04 10:28:54.038795 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 264/561] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:53 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:55.059984 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b477ea84-cbf3-42c1-83b1-bddab4f568cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:55.060814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b477ea84-cbf3-42c1-83b1-bddab4f568cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:55.068504 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b477ea84-cbf3-42c1-83b1-bddab4f568cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:55.068946 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b477ea84-cbf3-42c1-83b1-bddab4f568cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:55.069708 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b477ea84-cbf3-42c1-83b1-bddab4f568cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:55.070134 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b477ea84-cbf3-42c1-83b1-bddab4f568cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:55.201143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b477ea84-cbf3-42c1-83b1-bddab4f568cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:55.208774 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b477ea84-cbf3-42c1-83b1-bddab4f568cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1681 microversion: 2.1 time: 0.152690 Aug 04 10:28:55.209339 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 298/562] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:55 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:55.525650 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6e0beb7c-fe1e-4e52-8600-194170a369c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:55.526179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6e0beb7c-fe1e-4e52-8600-194170a369c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:55.532605 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6e0beb7c-fe1e-4e52-8600-194170a369c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:55.533554 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6e0beb7c-fe1e-4e52-8600-194170a369c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:55.534304 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6e0beb7c-fe1e-4e52-8600-194170a369c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:55.534738 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6e0beb7c-fe1e-4e52-8600-194170a369c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:55.616296 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-6e0beb7c-fe1e-4e52-8600-194170a369c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lazy-loading 'services' on Instance uuid cf60275d-fda6-4f0c-8a2f-14f85d685623 {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:28:55.689056 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6e0beb7c-fe1e-4e52-8600-194170a369c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/os-volume_attachments/6b7510da-1c03-416d-9382-666a9e7bbd3d" status: 202 len: 0 microversion: 2.1 time: 0.167036 Aug 04 10:28:55.689676 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 265/563] 10.222.0.72 () {58 vars in 1416 bytes} [Thu Aug 4 10:28:55 2022] DELETE /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/os-volume_attachments/6b7510da-1c03-416d-9382-666a9e7bbd3d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:28:56.229765 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fb042224-19b6-40fd-a17f-b1e5a6baad15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:56.230373 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fb042224-19b6-40fd-a17f-b1e5a6baad15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:56.236812 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb042224-19b6-40fd-a17f-b1e5a6baad15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:56.237260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb042224-19b6-40fd-a17f-b1e5a6baad15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:56.238017 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb042224-19b6-40fd-a17f-b1e5a6baad15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:56.238448 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb042224-19b6-40fd-a17f-b1e5a6baad15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:56.382545 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fb042224-19b6-40fd-a17f-b1e5a6baad15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:56.393029 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fb042224-19b6-40fd-a17f-b1e5a6baad15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1681 microversion: 2.1 time: 0.166380 Aug 04 10:28:56.393590 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 299/564] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:56 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:57.414804 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5e5d669a-4c32-4e03-8f8d-616d988349e5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:57.415500 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5e5d669a-4c32-4e03-8f8d-616d988349e5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:57.421890 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5e5d669a-4c32-4e03-8f8d-616d988349e5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:57.422332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5e5d669a-4c32-4e03-8f8d-616d988349e5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:57.423092 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5e5d669a-4c32-4e03-8f8d-616d988349e5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:57.423583 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5e5d669a-4c32-4e03-8f8d-616d988349e5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:57.552244 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5e5d669a-4c32-4e03-8f8d-616d988349e5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:57.559646 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5e5d669a-4c32-4e03-8f8d-616d988349e5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1681 microversion: 2.1 time: 0.149517 Aug 04 10:28:57.560249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 266/565] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:57 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:58.582564 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a0b40006-640c-4d78-9665-23fb69e00bda tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:58.583173 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a0b40006-640c-4d78-9665-23fb69e00bda tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:58.589753 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a0b40006-640c-4d78-9665-23fb69e00bda tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:58.590200 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a0b40006-640c-4d78-9665-23fb69e00bda tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:58.590960 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a0b40006-640c-4d78-9665-23fb69e00bda tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:58.591393 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a0b40006-640c-4d78-9665-23fb69e00bda tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:58.722875 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a0b40006-640c-4d78-9665-23fb69e00bda tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:58.730289 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a0b40006-640c-4d78-9665-23fb69e00bda tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1681 microversion: 2.1 time: 0.152668 Aug 04 10:28:58.730852 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 300/566] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:58 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:28:59.751464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-fc16691c-b0f1-4ebf-b782-818365fac779 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:28:59.752087 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-fc16691c-b0f1-4ebf-b782-818365fac779 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:28:59.759122 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fc16691c-b0f1-4ebf-b782-818365fac779 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:59.759561 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fc16691c-b0f1-4ebf-b782-818365fac779 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:59.760337 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fc16691c-b0f1-4ebf-b782-818365fac779 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:28:59.760765 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fc16691c-b0f1-4ebf-b782-818365fac779 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:28:59.895939 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-fc16691c-b0f1-4ebf-b782-818365fac779 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:28:59.903323 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-fc16691c-b0f1-4ebf-b782-818365fac779 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1681 microversion: 2.1 time: 0.155709 Aug 04 10:28:59.903884 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 267/567] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:28:59 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:29:00.923573 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ef0034b5-1763-4088-b36b-f89b5849315a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:00.924456 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ef0034b5-1763-4088-b36b-f89b5849315a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:00.931499 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef0034b5-1763-4088-b36b-f89b5849315a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:00.931943 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef0034b5-1763-4088-b36b-f89b5849315a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:00.932778 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef0034b5-1763-4088-b36b-f89b5849315a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:00.933213 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef0034b5-1763-4088-b36b-f89b5849315a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:00.996386 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ef0034b5-1763-4088-b36b-f89b5849315a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:01.006338 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ef0034b5-1763-4088-b36b-f89b5849315a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1614 microversion: 2.1 time: 0.086463 Aug 04 10:29:01.013969 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 301/568] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:00 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1614 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:01.049889 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dc41fa06-f1b2-4dd8-84b4-01adaf955c99 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:01.056599 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dc41fa06-f1b2-4dd8-84b4-01adaf955c99 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:01.057074 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dc41fa06-f1b2-4dd8-84b4-01adaf955c99 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:01.079184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dc41fa06-f1b2-4dd8-84b4-01adaf955c99 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Going to try to stop instance {{(pid=117667) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 10:29:01.122460 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-dc41fa06-f1b2-4dd8-84b4-01adaf955c99 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "POST /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/action" status: 202 len: 0 microversion: 2.1 time: 0.076401 Aug 04 10:29:01.122967 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 268/569] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:29:01 2022] POST /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:29:01.141840 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f7a6102e-e4bd-42aa-b198-fb6776792914 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:01.142470 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f7a6102e-e4bd-42aa-b198-fb6776792914 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:01.156366 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f7a6102e-e4bd-42aa-b198-fb6776792914 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:01.157032 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f7a6102e-e4bd-42aa-b198-fb6776792914 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:01.157823 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f7a6102e-e4bd-42aa-b198-fb6776792914 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:01.162521 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f7a6102e-e4bd-42aa-b198-fb6776792914 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:01.197344 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-26304ad9-48e2-4d5f-8ffd-ac65e8ab84e6 req-8e20d23e-bd6a-404e-bf7e-61bef575f9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323e8a06-ea21-43a6-a575-4973b1616653", "name": "network-vif-deleted", "tag": "29a7efd8-df13-46cd-a651-5322ba5514a9"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:01.207929 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-26304ad9-48e2-4d5f-8ffd-ac65e8ab84e6 req-8e20d23e-bd6a-404e-bf7e-61bef575f9d5 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:01.208452 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-26304ad9-48e2-4d5f-8ffd-ac65e8ab84e6 req-8e20d23e-bd6a-404e-bf7e-61bef575f9d5 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:01.221906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-26304ad9-48e2-4d5f-8ffd-ac65e8ab84e6 req-8e20d23e-bd6a-404e-bf7e-61bef575f9d5 service nova] Creating event network-vif-deleted:29a7efd8-df13-46cd-a651-5322ba5514a9 for instance 323e8a06-ea21-43a6-a575-4973b1616653 on hv-cinder-82660 Aug 04 10:29:01.227530 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-26304ad9-48e2-4d5f-8ffd-ac65e8ab84e6 req-8e20d23e-bd6a-404e-bf7e-61bef575f9d5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034320 Aug 04 10:29:01.232069 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 269/570] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:29:01.332293 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f7a6102e-e4bd-42aa-b198-fb6776792914 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:01.340553 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f7a6102e-e4bd-42aa-b198-fb6776792914 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1676 microversion: 2.1 time: 0.212385 Aug 04 10:29:01.341150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 302/571] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:01 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:02.041084 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-659c047f-7395-451d-ab84-f550dab7ef92 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:02.042162 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-659c047f-7395-451d-ab84-f550dab7ef92 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:02.051549 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-659c047f-7395-451d-ab84-f550dab7ef92 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:02.052846 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-659c047f-7395-451d-ab84-f550dab7ef92 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:02.053977 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-659c047f-7395-451d-ab84-f550dab7ef92 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:02.055048 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-659c047f-7395-451d-ab84-f550dab7ef92 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:02.117618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-659c047f-7395-451d-ab84-f550dab7ef92 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:02.118575 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-659c047f-7395-451d-ab84-f550dab7ef92 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:02.119193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-659c047f-7395-451d-ab84-f550dab7ef92 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lazy-loading 'fault' on Instance uuid 323e8a06-ea21-43a6-a575-4973b1616653 {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:29:02.172260 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-659c047f-7395-451d-ab84-f550dab7ef92 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:02.180156 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-659c047f-7395-451d-ab84-f550dab7ef92 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 200 len: 1331 microversion: 2.1 time: 0.143855 Aug 04 10:29:02.193311 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 270/572] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:02 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 1331 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:02.361599 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8f5caddc-7fc3-4303-806f-26a3f3a9f44d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:02.362973 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8f5caddc-7fc3-4303-806f-26a3f3a9f44d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:02.369237 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8f5caddc-7fc3-4303-806f-26a3f3a9f44d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:02.369680 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8f5caddc-7fc3-4303-806f-26a3f3a9f44d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:02.370437 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8f5caddc-7fc3-4303-806f-26a3f3a9f44d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:02.370859 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8f5caddc-7fc3-4303-806f-26a3f3a9f44d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:02.506731 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8f5caddc-7fc3-4303-806f-26a3f3a9f44d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:02.515832 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8f5caddc-7fc3-4303-806f-26a3f3a9f44d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1676 microversion: 2.1 time: 0.158030 Aug 04 10:29:02.516457 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 303/573] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:02 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:03.201051 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b45d1bc2-6876-4e3f-8b8e-d64b355060c2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:03.201714 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b45d1bc2-6876-4e3f-8b8e-d64b355060c2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:03.208891 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b45d1bc2-6876-4e3f-8b8e-d64b355060c2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:03.209343 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b45d1bc2-6876-4e3f-8b8e-d64b355060c2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:03.210144 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b45d1bc2-6876-4e3f-8b8e-d64b355060c2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:03.210613 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b45d1bc2-6876-4e3f-8b8e-d64b355060c2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:03.227931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-b45d1bc2-6876-4e3f-8b8e-d64b355060c2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] HTTP exception thrown: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b45d1bc2-6876-4e3f-8b8e-d64b355060c2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Request method failure captured: Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 HTTP/1.1 Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656Tob97WbD_ZS5F2g-QN7pC61pEa9bei56wET8TrZeizeYQWOy31gmFZi3BtMbEG-sSRMiaAjSOk7-SIrWX3R_-R1F1qjTprnkQ7VwtSLuza02D0xNMbtZfy2jBcBSsmOWIl7uTSBWVqK40vdniduqG7S6ibX_f6b3y_2MqFav-ZhA Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:29:03.229904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:29:03.231224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:29:03.231224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:29:03.231224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:29:03.231224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:29:03.231224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:29:03.231224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:29:03.231224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:29:03.231224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: b680411b142642b7acc3585d2481f880 Aug 04 10:29:03.231224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:29:03.231224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:29:03.231224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:29:03.231224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '323e8a06-ea21-43a6-a575-4973b1616653'} Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:29:03.231948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:29:03.233246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:29:03.234343 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b45d1bc2-6876-4e3f-8b8e-d64b355060c2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Returning 404 to user: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:29:03.234343 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b45d1bc2-6876-4e3f-8b8e-d64b355060c2 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 404 len: 111 microversion: 2.1 time: 0.034255 Aug 04 10:29:03.234343 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 271/574] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:03 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:29:03.240890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-71772cf7-4422-4167-bb33-76925a99efad tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '.version_select at 0x7fbaa50335e0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:03.262950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-71772cf7-4422-4167-bb33-76925a99efad tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-333771551" status: 202 len: 0 microversion: 2.1 time: 0.026059 Aug 04 10:29:03.267435 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 304/575] 10.222.0.72 () {58 vars in 1218 bytes} [Thu Aug 4 10:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-333771551 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:29:03.538529 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4d098b2d-bb13-4c83-a39d-9c87f2947838 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:03.539246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4d098b2d-bb13-4c83-a39d-9c87f2947838 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:03.545243 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4d098b2d-bb13-4c83-a39d-9c87f2947838 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:03.545691 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4d098b2d-bb13-4c83-a39d-9c87f2947838 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:03.546472 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4d098b2d-bb13-4c83-a39d-9c87f2947838 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:03.546905 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4d098b2d-bb13-4c83-a39d-9c87f2947838 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:03.551376 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:03.851609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ef139a7b-0410-4e16-8cef-e3783cdf7703 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:03.852228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ef139a7b-0410-4e16-8cef-e3783cdf7703 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:03.859230 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef139a7b-0410-4e16-8cef-e3783cdf7703 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:03.859676 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef139a7b-0410-4e16-8cef-e3783cdf7703 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:03.860479 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef139a7b-0410-4e16-8cef-e3783cdf7703 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:03.860913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef139a7b-0410-4e16-8cef-e3783cdf7703 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:03.978308 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4d098b2d-bb13-4c83-a39d-9c87f2947838 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:03.986375 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4d098b2d-bb13-4c83-a39d-9c87f2947838 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1676 microversion: 2.1 time: 0.452529 Aug 04 10:29:03.987117 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 272/576] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:03 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1676 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:03.990919 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-ef139a7b-0410-4e16-8cef-e3783cdf7703 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lazy-loading 'services' on Instance uuid d5581514-f76e-4812-ac8a-8ed2befcbb3e {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:29:04.117415 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ef139a7b-0410-4e16-8cef-e3783cdf7703 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e/os-volume_attachments/c3670dbc-6f58-40fa-be3a-c4c799474f7a" status: 202 len: 0 microversion: 2.1 time: 0.270863 Aug 04 10:29:04.118033 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 305/577] 10.222.0.72 () {58 vars in 1416 bytes} [Thu Aug 4 10:29:03 2022] DELETE /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e/os-volume_attachments/c3670dbc-6f58-40fa-be3a-c4c799474f7a => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 10:29:04.237583 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-aa1b1be4-b4a4-4a1b-94d6-5fad79864a2d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:04.238071 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-aa1b1be4-b4a4-4a1b-94d6-5fad79864a2d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:04.240415 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:04.246954 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-aa1b1be4-b4a4-4a1b-94d6-5fad79864a2d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:04.247392 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-aa1b1be4-b4a4-4a1b-94d6-5fad79864a2d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:04.248193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-aa1b1be4-b4a4-4a1b-94d6-5fad79864a2d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:04.248618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-aa1b1be4-b4a4-4a1b-94d6-5fad79864a2d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:04.329530 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-aa1b1be4-b4a4-4a1b-94d6-5fad79864a2d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lazy-loading 'services' on Instance uuid 1d55a58c-f47e-4284-9ffa-f7fb642845fb {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:29:04.413663 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-aa1b1be4-b4a4-4a1b-94d6-5fad79864a2d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-volume_attachments/cd5080ab-4aa1-4813-be6b-ccbf6b2cfa41" status: 202 len: 0 microversion: 2.1 time: 0.180449 Aug 04 10:29:04.414241 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 273/578] 10.222.0.72 () {58 vars in 1416 bytes} [Thu Aug 4 10:29:04 2022] DELETE /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-volume_attachments/cd5080ab-4aa1-4813-be6b-ccbf6b2cfa41 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:29:04.423276 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-648322fa-c583-48ff-b706-f15cc729913a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:04.426669 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-648322fa-c583-48ff-b706-f15cc729913a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:04.432935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-648322fa-c583-48ff-b706-f15cc729913a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:04.433375 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-648322fa-c583-48ff-b706-f15cc729913a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:04.434124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-648322fa-c583-48ff-b706-f15cc729913a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:04.434554 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-648322fa-c583-48ff-b706-f15cc729913a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:04.463509 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-648322fa-c583-48ff-b706-f15cc729913a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044563 Aug 04 10:29:04.464067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 306/579] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:29:04 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:29:05.008412 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-77cd04b0-c20b-47c4-a041-80aecc4645cb tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:05.009113 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-77cd04b0-c20b-47c4-a041-80aecc4645cb tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:05.015376 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-77cd04b0-c20b-47c4-a041-80aecc4645cb tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:05.015827 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-77cd04b0-c20b-47c4-a041-80aecc4645cb tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:05.016636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-77cd04b0-c20b-47c4-a041-80aecc4645cb tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:05.017076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-77cd04b0-c20b-47c4-a041-80aecc4645cb tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:05.152271 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-77cd04b0-c20b-47c4-a041-80aecc4645cb tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:05.159735 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-77cd04b0-c20b-47c4-a041-80aecc4645cb tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1676 microversion: 2.1 time: 0.155900 Aug 04 10:29:05.160327 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 274/580] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:05 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:05.243198 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-88f93a47-9631-4d72-ac27-c072efe231d7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:05.243715 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-88f93a47-9631-4d72-ac27-c072efe231d7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:05.250387 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-88f93a47-9631-4d72-ac27-c072efe231d7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:05.250832 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-88f93a47-9631-4d72-ac27-c072efe231d7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:05.251597 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-88f93a47-9631-4d72-ac27-c072efe231d7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:05.252065 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-88f93a47-9631-4d72-ac27-c072efe231d7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:05.279559 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-88f93a47-9631-4d72-ac27-c072efe231d7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:29:05.328421 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:05.356168 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-88f93a47-9631-4d72-ac27-c072efe231d7 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 204 len: 0 microversion: 2.1 time: 0.116527 Aug 04 10:29:05.356747 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 307/581] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:29:05 2022] DELETE /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:29:05.364771 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8d1e11ab-1a8f-4328-948e-a3d6a6a73b49 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:05.365383 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8d1e11ab-1a8f-4328-948e-a3d6a6a73b49 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:05.371829 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8d1e11ab-1a8f-4328-948e-a3d6a6a73b49 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:05.372313 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8d1e11ab-1a8f-4328-948e-a3d6a6a73b49 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:05.373072 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8d1e11ab-1a8f-4328-948e-a3d6a6a73b49 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:05.373507 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8d1e11ab-1a8f-4328-948e-a3d6a6a73b49 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:05.476754 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-046b7304-57b4-4c9b-b6bf-f07424e3a8ef tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:05.479001 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-046b7304-57b4-4c9b-b6bf-f07424e3a8ef tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:05.485058 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-046b7304-57b4-4c9b-b6bf-f07424e3a8ef tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:05.485533 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-046b7304-57b4-4c9b-b6bf-f07424e3a8ef tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:05.486296 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-046b7304-57b4-4c9b-b6bf-f07424e3a8ef tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:05.487266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-046b7304-57b4-4c9b-b6bf-f07424e3a8ef tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:05.510417 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8d1e11ab-1a8f-4328-948e-a3d6a6a73b49 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:05.518452 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8d1e11ab-1a8f-4328-948e-a3d6a6a73b49 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1559 microversion: 2.1 time: 0.157360 Aug 04 10:29:05.530796 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 275/582] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:05 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:05.531469 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-046b7304-57b4-4c9b-b6bf-f07424e3a8ef tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048969 Aug 04 10:29:05.531469 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 308/583] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:29:05 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:29:06.181789 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4a573917-c7b8-4ae2-b895-1f19cf39888b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:06.182297 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4a573917-c7b8-4ae2-b895-1f19cf39888b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:06.188464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4a573917-c7b8-4ae2-b895-1f19cf39888b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:06.188910 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4a573917-c7b8-4ae2-b895-1f19cf39888b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:06.189668 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4a573917-c7b8-4ae2-b895-1f19cf39888b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:06.190105 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4a573917-c7b8-4ae2-b895-1f19cf39888b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:06.327142 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4a573917-c7b8-4ae2-b895-1f19cf39888b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:06.335399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4a573917-c7b8-4ae2-b895-1f19cf39888b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1676 microversion: 2.1 time: 0.157424 Aug 04 10:29:06.336048 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 276/584] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:06 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:06.533035 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f5fdc59f-0dee-40d2-94df-b0c55bf11cf4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:06.535882 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f5fdc59f-0dee-40d2-94df-b0c55bf11cf4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:06.540702 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-49852abe-a5a5-4205-b5a4-d1865226d733 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:06.541303 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-49852abe-a5a5-4205-b5a4-d1865226d733 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:06.542461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5fdc59f-0dee-40d2-94df-b0c55bf11cf4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:06.542905 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5fdc59f-0dee-40d2-94df-b0c55bf11cf4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:06.543663 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5fdc59f-0dee-40d2-94df-b0c55bf11cf4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:06.544198 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f5fdc59f-0dee-40d2-94df-b0c55bf11cf4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:06.547904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-49852abe-a5a5-4205-b5a4-d1865226d733 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:06.548370 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-49852abe-a5a5-4205-b5a4-d1865226d733 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:06.549120 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-49852abe-a5a5-4205-b5a4-d1865226d733 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:06.550586 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-49852abe-a5a5-4205-b5a4-d1865226d733 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:06.574435 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f5fdc59f-0dee-40d2-94df-b0c55bf11cf4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045367 Aug 04 10:29:06.575126 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 309/585] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:29:06 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:29:06.682139 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-49852abe-a5a5-4205-b5a4-d1865226d733 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:06.689568 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-49852abe-a5a5-4205-b5a4-d1865226d733 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1513 microversion: 2.1 time: 0.152764 Aug 04 10:29:06.690132 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 277/586] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:06 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:29:07.357308 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-293c74cd-25db-4bb8-96fd-f7e2bd90882d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:07.357923 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-293c74cd-25db-4bb8-96fd-f7e2bd90882d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:07.363933 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-293c74cd-25db-4bb8-96fd-f7e2bd90882d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:07.364426 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-293c74cd-25db-4bb8-96fd-f7e2bd90882d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:07.365245 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-293c74cd-25db-4bb8-96fd-f7e2bd90882d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:07.365677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-293c74cd-25db-4bb8-96fd-f7e2bd90882d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:07.495587 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-293c74cd-25db-4bb8-96fd-f7e2bd90882d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:07.503692 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-293c74cd-25db-4bb8-96fd-f7e2bd90882d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1676 microversion: 2.1 time: 0.150233 Aug 04 10:29:07.504232 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 310/587] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:07 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:07.587276 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f537948c-0380-41cb-95ff-1b2d6857ef18 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:07.589543 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f537948c-0380-41cb-95ff-1b2d6857ef18 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:07.596237 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f537948c-0380-41cb-95ff-1b2d6857ef18 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:07.596679 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f537948c-0380-41cb-95ff-1b2d6857ef18 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:07.597440 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f537948c-0380-41cb-95ff-1b2d6857ef18 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:07.597866 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f537948c-0380-41cb-95ff-1b2d6857ef18 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:07.625984 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f537948c-0380-41cb-95ff-1b2d6857ef18 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042611 Aug 04 10:29:07.626530 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 278/588] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:29:07 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:29:07.710175 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a67c1f07-46a2-4e99-8fdd-6d653f9d7817 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:07.710778 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a67c1f07-46a2-4e99-8fdd-6d653f9d7817 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:07.717244 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a67c1f07-46a2-4e99-8fdd-6d653f9d7817 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:07.717686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a67c1f07-46a2-4e99-8fdd-6d653f9d7817 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:07.718438 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a67c1f07-46a2-4e99-8fdd-6d653f9d7817 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:07.718871 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a67c1f07-46a2-4e99-8fdd-6d653f9d7817 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:07.847506 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a67c1f07-46a2-4e99-8fdd-6d653f9d7817 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:07.855003 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a67c1f07-46a2-4e99-8fdd-6d653f9d7817 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1513 microversion: 2.1 time: 0.148695 Aug 04 10:29:07.855561 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 311/589] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:07 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:08.526647 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8c04dc3a-3676-4b2f-aa98-3bcf396029c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:08.527423 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8c04dc3a-3676-4b2f-aa98-3bcf396029c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:08.534405 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8c04dc3a-3676-4b2f-aa98-3bcf396029c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:08.534838 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8c04dc3a-3676-4b2f-aa98-3bcf396029c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:08.535604 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8c04dc3a-3676-4b2f-aa98-3bcf396029c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:08.536053 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8c04dc3a-3676-4b2f-aa98-3bcf396029c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:08.600152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-0be948ab-bba6-4674-80b1-82be1c9eae0c req-a711c58f-1984-400a-9b6d-ffbc1929e5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5581514-f76e-4812-ac8a-8ed2befcbb3e", "name": "network-vif-deleted", "tag": "7d784c14-cead-49fc-943b-03bac4cf8871"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:08.609777 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-0be948ab-bba6-4674-80b1-82be1c9eae0c req-a711c58f-1984-400a-9b6d-ffbc1929e5d0 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:08.610146 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-0be948ab-bba6-4674-80b1-82be1c9eae0c req-a711c58f-1984-400a-9b6d-ffbc1929e5d0 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:08.621800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-0be948ab-bba6-4674-80b1-82be1c9eae0c req-a711c58f-1984-400a-9b6d-ffbc1929e5d0 service nova] Creating event network-vif-deleted:7d784c14-cead-49fc-943b-03bac4cf8871 for instance d5581514-f76e-4812-ac8a-8ed2befcbb3e on hv-cinder-82660 Aug 04 10:29:08.627278 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-0be948ab-bba6-4674-80b1-82be1c9eae0c req-a711c58f-1984-400a-9b6d-ffbc1929e5d0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031300 Aug 04 10:29:08.627889 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 312/590] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:29:08.639219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e14eb069-37aa-4c12-a835-5d0eb50f3230 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:08.641691 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e14eb069-37aa-4c12-a835-5d0eb50f3230 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:08.649182 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e14eb069-37aa-4c12-a835-5d0eb50f3230 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:08.649665 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e14eb069-37aa-4c12-a835-5d0eb50f3230 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:08.650441 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e14eb069-37aa-4c12-a835-5d0eb50f3230 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:08.650932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e14eb069-37aa-4c12-a835-5d0eb50f3230 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:08.682373 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e14eb069-37aa-4c12-a835-5d0eb50f3230 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047325 Aug 04 10:29:08.682957 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 313/591] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:29:08 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 10:29:08.698351 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8c04dc3a-3676-4b2f-aa98-3bcf396029c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:08.706928 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8c04dc3a-3676-4b2f-aa98-3bcf396029c6 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1676 microversion: 2.1 time: 0.185606 Aug 04 10:29:08.707491 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 279/592] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:08 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:08.749174 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b922ae8d-b910-442d-ad12-aeea6f5e8c96 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:08.749715 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b922ae8d-b910-442d-ad12-aeea6f5e8c96 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:08.756332 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b922ae8d-b910-442d-ad12-aeea6f5e8c96 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:08.756794 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b922ae8d-b910-442d-ad12-aeea6f5e8c96 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:08.757603 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b922ae8d-b910-442d-ad12-aeea6f5e8c96 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:08.757986 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b922ae8d-b910-442d-ad12-aeea6f5e8c96 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:08.785336 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b922ae8d-b910-442d-ad12-aeea6f5e8c96 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:29:08.861554 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b922ae8d-b910-442d-ad12-aeea6f5e8c96 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 204 len: 0 microversion: 2.1 time: 0.115847 Aug 04 10:29:08.862070 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 314/593] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:29:08 2022] DELETE /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:29:08.870246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1598249f-67bc-48c9-b548-f6865f40d417 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:08.870935 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-1598249f-67bc-48c9-b548-f6865f40d417 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:08.875978 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8452a724-da82-443b-8d5a-b36dc6438be3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:08.876700 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8452a724-da82-443b-8d5a-b36dc6438be3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:08.877108 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1598249f-67bc-48c9-b548-f6865f40d417 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:08.878123 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1598249f-67bc-48c9-b548-f6865f40d417 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:08.878884 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1598249f-67bc-48c9-b548-f6865f40d417 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:08.879314 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1598249f-67bc-48c9-b548-f6865f40d417 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:08.883163 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8452a724-da82-443b-8d5a-b36dc6438be3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:08.883622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8452a724-da82-443b-8d5a-b36dc6438be3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:08.884416 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8452a724-da82-443b-8d5a-b36dc6438be3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:08.884852 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8452a724-da82-443b-8d5a-b36dc6438be3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:08.915543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8452a724-da82-443b-8d5a-b36dc6438be3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:08.916021 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8452a724-da82-443b-8d5a-b36dc6438be3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:08.916485 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-8452a724-da82-443b-8d5a-b36dc6438be3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lazy-loading 'fault' on Instance uuid d5581514-f76e-4812-ac8a-8ed2befcbb3e {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:29:08.972126 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8452a724-da82-443b-8d5a-b36dc6438be3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:08.979524 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8452a724-da82-443b-8d5a-b36dc6438be3 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1308 microversion: 2.1 time: 0.107552 Aug 04 10:29:08.980118 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 315/594] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:08 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:29:09.034262 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-1598249f-67bc-48c9-b548-f6865f40d417 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:09.042015 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-1598249f-67bc-48c9-b548-f6865f40d417 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1681 microversion: 2.1 time: 0.175569 Aug 04 10:29:09.042590 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 280/595] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:08 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:09.728735 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9e214a78-0fbf-4504-b54d-a79d249037b1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:09.729335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9e214a78-0fbf-4504-b54d-a79d249037b1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:09.735292 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e214a78-0fbf-4504-b54d-a79d249037b1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:09.735746 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e214a78-0fbf-4504-b54d-a79d249037b1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:09.736539 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e214a78-0fbf-4504-b54d-a79d249037b1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:09.736978 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e214a78-0fbf-4504-b54d-a79d249037b1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:09.870256 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9e214a78-0fbf-4504-b54d-a79d249037b1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:09.877565 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9e214a78-0fbf-4504-b54d-a79d249037b1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1676 microversion: 2.1 time: 0.152658 Aug 04 10:29:09.878124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 316/596] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:09 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:10.000547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-973bc254-de0f-4a63-a953-85508b598018 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:10.001120 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-973bc254-de0f-4a63-a953-85508b598018 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:10.007644 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-973bc254-de0f-4a63-a953-85508b598018 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:10.008120 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-973bc254-de0f-4a63-a953-85508b598018 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:10.008871 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-973bc254-de0f-4a63-a953-85508b598018 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:10.009306 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-973bc254-de0f-4a63-a953-85508b598018 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:10.041293 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-973bc254-de0f-4a63-a953-85508b598018 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:10.041769 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-973bc254-de0f-4a63-a953-85508b598018 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:10.042229 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-973bc254-de0f-4a63-a953-85508b598018 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lazy-loading 'fault' on Instance uuid d5581514-f76e-4812-ac8a-8ed2befcbb3e {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:29:10.063294 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6282a09b-757a-482b-8c32-7492957ca47a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:10.064034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6282a09b-757a-482b-8c32-7492957ca47a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:10.071120 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6282a09b-757a-482b-8c32-7492957ca47a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:10.071660 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6282a09b-757a-482b-8c32-7492957ca47a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:10.072601 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6282a09b-757a-482b-8c32-7492957ca47a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:10.073088 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6282a09b-757a-482b-8c32-7492957ca47a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:10.083551 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-973bc254-de0f-4a63-a953-85508b598018 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20047857e8c4e36a031813729c09a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25fefc765ecb42728a941ddad185e082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:10.091945 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-973bc254-de0f-4a63-a953-85508b598018 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 200 len: 1308 microversion: 2.1 time: 0.095284 Aug 04 10:29:10.092525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 281/597] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:09 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:10.216535 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6282a09b-757a-482b-8c32-7492957ca47a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:10.224873 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6282a09b-757a-482b-8c32-7492957ca47a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1681 microversion: 2.1 time: 0.165956 Aug 04 10:29:10.225566 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 317/598] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:10 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:29:10.899061 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-23a46296-71c6-4a39-8246-0bb69550ee77 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:10.899576 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-23a46296-71c6-4a39-8246-0bb69550ee77 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:10.905656 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-23a46296-71c6-4a39-8246-0bb69550ee77 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:10.906099 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-23a46296-71c6-4a39-8246-0bb69550ee77 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:10.906845 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-23a46296-71c6-4a39-8246-0bb69550ee77 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:10.907269 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-23a46296-71c6-4a39-8246-0bb69550ee77 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:11.046943 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-23a46296-71c6-4a39-8246-0bb69550ee77 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:11.054826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-23a46296-71c6-4a39-8246-0bb69550ee77 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1676 microversion: 2.1 time: 0.159707 Aug 04 10:29:11.055393 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 282/599] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:10 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:29:11.112658 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-53d48734-c220-4e40-bbff-e29572eaf613 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:11.113261 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-53d48734-c220-4e40-bbff-e29572eaf613 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] [instance: d5581514-f76e-4812-ac8a-8ed2befcbb3e] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:11.120110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-53d48734-c220-4e40-bbff-e29572eaf613 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:11.120636 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-53d48734-c220-4e40-bbff-e29572eaf613 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:11.121411 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-53d48734-c220-4e40-bbff-e29572eaf613 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:11.121844 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-53d48734-c220-4e40-bbff-e29572eaf613 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:11.138144 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-53d48734-c220-4e40-bbff-e29572eaf613 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] HTTP exception thrown: Instance d5581514-f76e-4812-ac8a-8ed2befcbb3e could not be found. Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-53d48734-c220-4e40-bbff-e29572eaf613 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Request method failure captured: Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e HTTP/1.1 Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi657gM1WoHrHb_b9429bfYJTe6WIKZQR2azBwK82JG-mYRuJidwOFrftKzr4ou9sOGSVbMzLCbn-xWOWmO3KBht4BrZkB4nv_UxKK-M_yuBQmrMqxQobUQ6LMdiuBJAxxy0reoJpSk78lFeMr3HwHIf0FvNkVaqXJhg7ytMPxlKtoyK8 Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 25fefc765ecb42728a941ddad185e082 Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1655726524 Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:29:11.140110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:29:11.141371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/25fefc765ecb42728a941ddad185e082"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/25fefc765ecb42728a941ddad185e082"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/25fefc765ecb42728a941ddad185e082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_25fefc765ecb42728a941ddad185e082"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:29:11.141371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-VolumesSnapshotTestJSON-1655726524 Aug 04 10:29:11.141371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 25fefc765ecb42728a941ddad185e082 Aug 04 10:29:11.141371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1655726524 Aug 04 10:29:11.141371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-VolumesSnapshotTestJSON-1655726524-project Aug 04 10:29:11.141371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:29:11.141371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:29:11.141371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: f20047857e8c4e36a031813729c09a2b Aug 04 10:29:11.141371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-VolumesSnapshotTestJSON-1655726524-project Aug 04 10:29:11.141371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:29:11.141371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance d5581514-f76e-4812-ac8a-8ed2befcbb3e could not be found. Aug 04 10:29:11.141371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': 'd5581514-f76e-4812-ac8a-8ed2befcbb3e'} Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5581514-f76e-4812-ac8a-8ed2befcbb3e could not be found. Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:29:11.142805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5581514-f76e-4812-ac8a-8ed2befcbb3e could not be found. Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5581514-f76e-4812-ac8a-8ed2befcbb3e could not be found. Aug 04 10:29:11.145385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:11.146868 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-53d48734-c220-4e40-bbff-e29572eaf613 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] Returning 404 to user: Instance d5581514-f76e-4812-ac8a-8ed2befcbb3e could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:29:11.146868 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-53d48734-c220-4e40-bbff-e29572eaf613 tempest-VolumesSnapshotTestJSON-1655726524 tempest-VolumesSnapshotTestJSON-1655726524-project] 10.222.0.72 "GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e" status: 404 len: 111 microversion: 2.1 time: 0.033290 Aug 04 10:29:11.149209 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 318/600] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:11 2022] GET /compute/v2.1/servers/d5581514-f76e-4812-ac8a-8ed2befcbb3e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:29:11.249408 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6db0b06b-6fbb-478b-8e43-ec55427b511c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:11.250033 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6db0b06b-6fbb-478b-8e43-ec55427b511c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:11.257689 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6db0b06b-6fbb-478b-8e43-ec55427b511c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:11.258459 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6db0b06b-6fbb-478b-8e43-ec55427b511c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:11.259269 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6db0b06b-6fbb-478b-8e43-ec55427b511c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:11.259865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6db0b06b-6fbb-478b-8e43-ec55427b511c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:11.435581 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6db0b06b-6fbb-478b-8e43-ec55427b511c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:11.455471 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6db0b06b-6fbb-478b-8e43-ec55427b511c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 200 len: 1681 microversion: 2.1 time: 0.203011 Aug 04 10:29:11.460397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 283/601] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:11 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:11.898073 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-18ccd14c-36ee-4baa-93ff-6cd546b330b3 req-935d018e-3c91-4c9b-b467-5d83f4d0c78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d55a58c-f47e-4284-9ffa-f7fb642845fb", "name": "network-vif-deleted", "tag": "a1ddb5a5-2348-4975-a3d0-581514d978c0"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:11.907088 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-18ccd14c-36ee-4baa-93ff-6cd546b330b3 req-935d018e-3c91-4c9b-b467-5d83f4d0c78c service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:11.907519 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-18ccd14c-36ee-4baa-93ff-6cd546b330b3 req-935d018e-3c91-4c9b-b467-5d83f4d0c78c service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:11.919832 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-18ccd14c-36ee-4baa-93ff-6cd546b330b3 req-935d018e-3c91-4c9b-b467-5d83f4d0c78c service nova] Creating event network-vif-deleted:a1ddb5a5-2348-4975-a3d0-581514d978c0 for instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb on hv-cinder-82660 Aug 04 10:29:11.927075 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-18ccd14c-36ee-4baa-93ff-6cd546b330b3 req-935d018e-3c91-4c9b-b467-5d83f4d0c78c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034405 Aug 04 10:29:11.927643 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 319/602] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:29:12.079212 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8eee8d9e-2e45-4add-90fa-53e038733c3b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:12.080040 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8eee8d9e-2e45-4add-90fa-53e038733c3b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:12.088398 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8eee8d9e-2e45-4add-90fa-53e038733c3b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:12.089072 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8eee8d9e-2e45-4add-90fa-53e038733c3b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:12.089947 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8eee8d9e-2e45-4add-90fa-53e038733c3b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:12.090601 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8eee8d9e-2e45-4add-90fa-53e038733c3b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:12.242760 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8eee8d9e-2e45-4add-90fa-53e038733c3b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:12.251302 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8eee8d9e-2e45-4add-90fa-53e038733c3b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1676 microversion: 2.1 time: 0.176152 Aug 04 10:29:12.251751 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 284/603] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:12 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:12.482160 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-09a6d207-fb0f-4371-8502-a53c3fe24766 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:12.482978 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-09a6d207-fb0f-4371-8502-a53c3fe24766 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:12.492383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-09a6d207-fb0f-4371-8502-a53c3fe24766 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:12.492853 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-09a6d207-fb0f-4371-8502-a53c3fe24766 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:12.493644 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-09a6d207-fb0f-4371-8502-a53c3fe24766 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:12.494073 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-09a6d207-fb0f-4371-8502-a53c3fe24766 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:12.508492 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-09a6d207-fb0f-4371-8502-a53c3fe24766 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] HTTP exception thrown: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-09a6d207-fb0f-4371-8502-a53c3fe24766 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Request method failure captured: Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb HTTP/1.1 Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656Tob97WbD_ZS5F2g-QN7pC61pEa9bei56wET8TrZeizeYQWOy31gmFZi3BtMbEG-sSRMiaAjSOk7-SIrWX3R_-R1F1qjTprnkQ7VwtSLuza02D0xNMbtZfy2jBcBSsmOWIl7uTSBWVqK40vdniduqG7S6ibX_f6b3y_2MqFav-ZhA Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:29:12.510344 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:29:12.511596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:29:12.511596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:29:12.511596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:29:12.511596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:29:12.511596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:29:12.511596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:29:12.511596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:29:12.511596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: b680411b142642b7acc3585d2481f880 Aug 04 10:29:12.511596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:29:12.511596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:29:12.511596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:29:12.511596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '1d55a58c-f47e-4284-9ffa-f7fb642845fb'} Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:29:12.512335 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:29:12.514135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:12.516422 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-09a6d207-fb0f-4371-8502-a53c3fe24766 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Returning 404 to user: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:29:12.516422 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-09a6d207-fb0f-4371-8502-a53c3fe24766 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 404 len: 111 microversion: 2.1 time: 0.036395 Aug 04 10:29:12.516422 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 320/604] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:12 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:29:12.520680 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-131e09d4-e631-49b5-ac5d-d46925c1da5f tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '.version_select at 0x7fbaa473a3a0>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:12.542249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-131e09d4-e631-49b5-ac5d-d46925c1da5f tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-398068509" status: 202 len: 0 microversion: 2.1 time: 0.025179 Aug 04 10:29:12.542953 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 285/605] 10.222.0.72 () {58 vars in 1218 bytes} [Thu Aug 4 10:29:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-398068509 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:29:13.274825 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-eabf6fe0-fe98-4c77-97b2-d540b85a5707 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:13.275435 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-eabf6fe0-fe98-4c77-97b2-d540b85a5707 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:13.281451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eabf6fe0-fe98-4c77-97b2-d540b85a5707 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:13.281926 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eabf6fe0-fe98-4c77-97b2-d540b85a5707 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:13.282692 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eabf6fe0-fe98-4c77-97b2-d540b85a5707 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:13.283125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-eabf6fe0-fe98-4c77-97b2-d540b85a5707 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:13.480040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-eabf6fe0-fe98-4c77-97b2-d540b85a5707 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:13.480245 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6b8f320c-4cac-472e-90ba-24ca029246b4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Action: 'create', calling method: .version_select at 0x7fbaa46f03a0>, body: {"keypair": {"name": "tempest-keypair-139247792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmdBuIJBENaZAv5sg0d+qLc2lxkv2Pm3LRLBFE8AHmH+agW3glwzDl8xZTC8fiKXDbataqkjCe4fg+fbkQwMXO5EdJpG1w3BiUUa/DjrtAIQsf4ovpHwAivwN7RnhLujg=="}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:13.487742 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-eabf6fe0-fe98-4c77-97b2-d540b85a5707 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1676 microversion: 2.1 time: 0.216926 Aug 04 10:29:13.489057 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 321/606] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:13 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:13.496788 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-6b8f320c-4cac-472e-90ba-24ca029246b4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'key_pairs'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:29:13.500739 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-6b8f320c-4cac-472e-90ba-24ca029246b4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for user b680411b142642b7acc3585d2481f880 and project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'key_pairs'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:29:13.521495 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6b8f320c-4cac-472e-90ba-24ca029246b4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045979 Aug 04 10:29:13.522080 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 286/607] 10.222.0.72 () {60 vars in 1159 bytes} [Thu Aug 4 10:29:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:29:14.510041 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-89f8f77e-2732-46c9-b98d-f30a535b999f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:14.510872 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-89f8f77e-2732-46c9-b98d-f30a535b999f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:14.517118 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-89f8f77e-2732-46c9-b98d-f30a535b999f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:14.517561 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-89f8f77e-2732-46c9-b98d-f30a535b999f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:14.518309 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-89f8f77e-2732-46c9-b98d-f30a535b999f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:14.518734 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-89f8f77e-2732-46c9-b98d-f30a535b999f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:14.710016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-89f8f77e-2732-46c9-b98d-f30a535b999f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:14.718556 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-89f8f77e-2732-46c9-b98d-f30a535b999f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1676 microversion: 2.1 time: 0.212353 Aug 04 10:29:14.719163 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 322/608] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:14 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:14.914986 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2045745992", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "efa95d14-4335-4752-bcd1-62814f92872f"}], "security_groups": [{"name": "tempest-securitygroup--242384241"}], "key_name": "tempest-keypair-139247792", "user_data": "}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:15.020000 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.network.neutron [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] validate_networks() for [('efa95d14-4335-4752-bcd1-62814f92872f', None, None, None, None, None)] {{(pid=117667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:29:15.391464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Flavor limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:29:15.391911 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Image limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:29:15.392444 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Flavor pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:29:15.392851 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Image pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:29:15.393258 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:29:15.402004 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:15.402449 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:15.403238 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:15.403675 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:15.419930 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:29:15.423798 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for user b680411b142642b7acc3585d2481f880 and project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:29:15.435464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Going to run 1 instances... {{(pid=117667) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:29:15.437709 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:29:15.483678 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-568b1dc4-0e2a-4818-b515-80bb754d35c8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.573375 Aug 04 10:29:15.484498 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 287/609] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:29:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:29:15.495629 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e287d8d0-87c9-498e-a635-07b5d109701d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:15.496265 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e287d8d0-87c9-498e-a635-07b5d109701d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:15.551173 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e287d8d0-87c9-498e-a635-07b5d109701d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:15.558272 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e287d8d0-87c9-498e-a635-07b5d109701d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1241 microversion: 2.1 time: 0.066446 Aug 04 10:29:15.558845 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 323/610] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:15 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:15.741553 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ded8c3d4-e363-4efb-99b1-97df2fefa597 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:15.742220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ded8c3d4-e363-4efb-99b1-97df2fefa597 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:15.748437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ded8c3d4-e363-4efb-99b1-97df2fefa597 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:15.748886 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ded8c3d4-e363-4efb-99b1-97df2fefa597 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:15.749657 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ded8c3d4-e363-4efb-99b1-97df2fefa597 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:15.750346 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ded8c3d4-e363-4efb-99b1-97df2fefa597 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:15.899985 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-ded8c3d4-e363-4efb-99b1-97df2fefa597 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:15.908522 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ded8c3d4-e363-4efb-99b1-97df2fefa597 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1676 microversion: 2.1 time: 0.171019 Aug 04 10:29:15.909084 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 288/611] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:15 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:29:16.579035 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f14ba98a-2019-4a0d-8d9c-fa0710cf9e55 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:16.579639 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f14ba98a-2019-4a0d-8d9c-fa0710cf9e55 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:16.586867 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f14ba98a-2019-4a0d-8d9c-fa0710cf9e55 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:16.587314 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f14ba98a-2019-4a0d-8d9c-fa0710cf9e55 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:16.588208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f14ba98a-2019-4a0d-8d9c-fa0710cf9e55 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:16.588689 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f14ba98a-2019-4a0d-8d9c-fa0710cf9e55 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:16.664214 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f14ba98a-2019-4a0d-8d9c-fa0710cf9e55 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:16.672401 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f14ba98a-2019-4a0d-8d9c-fa0710cf9e55 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1293 microversion: 2.1 time: 0.097208 Aug 04 10:29:16.672993 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 324/612] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:16 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:16.932087 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ad1b2b67-a878-4729-9400-89e2dc711561 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:16.932945 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ad1b2b67-a878-4729-9400-89e2dc711561 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:16.939736 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ad1b2b67-a878-4729-9400-89e2dc711561 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:16.940228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ad1b2b67-a878-4729-9400-89e2dc711561 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:16.941055 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ad1b2b67-a878-4729-9400-89e2dc711561 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:16.941495 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ad1b2b67-a878-4729-9400-89e2dc711561 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:17.080831 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-ad1b2b67-a878-4729-9400-89e2dc711561 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:17.090318 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ad1b2b67-a878-4729-9400-89e2dc711561 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1653 microversion: 2.1 time: 0.163043 Aug 04 10:29:17.102688 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 289/613] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:16 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1653 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:17.113265 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e0a53ff7-c587-46ae-ba04-727ed7ad125a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:17.120092 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0a53ff7-c587-46ae-ba04-727ed7ad125a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:17.120550 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0a53ff7-c587-46ae-ba04-727ed7ad125a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:17.183182 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e0a53ff7-c587-46ae-ba04-727ed7ad125a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Going to try to start instance {{(pid=117666) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 10:29:17.197475 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:17.226730 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e0a53ff7-c587-46ae-ba04-727ed7ad125a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "POST /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/action" status: 202 len: 0 microversion: 2.1 time: 0.118163 Aug 04 10:29:17.227334 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 325/614] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:29:17 2022] POST /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:29:17.235400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b0322717-c5f2-47ec-a7e9-85b0a8d4d89b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:17.236025 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b0322717-c5f2-47ec-a7e9-85b0a8d4d89b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:17.242682 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b0322717-c5f2-47ec-a7e9-85b0a8d4d89b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:17.243139 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b0322717-c5f2-47ec-a7e9-85b0a8d4d89b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:17.243910 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b0322717-c5f2-47ec-a7e9-85b0a8d4d89b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:17.244939 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b0322717-c5f2-47ec-a7e9-85b0a8d4d89b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:17.264278 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:17.392970 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b0322717-c5f2-47ec-a7e9-85b0a8d4d89b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:17.402220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b0322717-c5f2-47ec-a7e9-85b0a8d4d89b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1662 microversion: 2.1 time: 0.170432 Aug 04 10:29:17.402857 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 290/615] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:17 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1662 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:17.698617 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-829028ee-ac9f-4685-92e5-f7f68df7f9c5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:17.699820 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-829028ee-ac9f-4685-92e5-f7f68df7f9c5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:17.702021 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:17.709669 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-829028ee-ac9f-4685-92e5-f7f68df7f9c5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:17.710241 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-829028ee-ac9f-4685-92e5-f7f68df7f9c5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:17.711044 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-829028ee-ac9f-4685-92e5-f7f68df7f9c5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:17.711482 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-829028ee-ac9f-4685-92e5-f7f68df7f9c5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:17.953521 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-829028ee-ac9f-4685-92e5-f7f68df7f9c5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:17.963433 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-829028ee-ac9f-4685-92e5-f7f68df7f9c5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1366 microversion: 2.1 time: 0.271597 Aug 04 10:29:17.977624 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 326/616] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:17 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:29:18.409760 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-36c1462c-6456-4dca-9534-a0e544e2fd4b req-cafd31ac-25e1-49d1-aec4-355852194237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228506d2-27e6-4bab-991d-0695ea9543c3", "tag": "adec20b2-5dff-4931-86b4-11c30465304f"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:18.426998 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-95e5cf81-dbad-4baf-bc2c-ea658f72f569 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:18.427861 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-95e5cf81-dbad-4baf-bc2c-ea658f72f569 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:18.432793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-36c1462c-6456-4dca-9534-a0e544e2fd4b req-cafd31ac-25e1-49d1-aec4-355852194237 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:18.433746 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-36c1462c-6456-4dca-9534-a0e544e2fd4b req-cafd31ac-25e1-49d1-aec4-355852194237 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:18.435237 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-95e5cf81-dbad-4baf-bc2c-ea658f72f569 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:18.435858 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-95e5cf81-dbad-4baf-bc2c-ea658f72f569 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:18.436849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-95e5cf81-dbad-4baf-bc2c-ea658f72f569 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:18.437448 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-95e5cf81-dbad-4baf-bc2c-ea658f72f569 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:18.449221 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-36c1462c-6456-4dca-9534-a0e544e2fd4b req-cafd31ac-25e1-49d1-aec4-355852194237 service nova] Creating event network-changed:adec20b2-5dff-4931-86b4-11c30465304f for instance 228506d2-27e6-4bab-991d-0695ea9543c3 on hv-cinder-82660 Aug 04 10:29:18.454913 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-36c1462c-6456-4dca-9534-a0e544e2fd4b req-cafd31ac-25e1-49d1-aec4-355852194237 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052516 Aug 04 10:29:18.455685 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 291/617] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:29:18.574862 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-95e5cf81-dbad-4baf-bc2c-ea658f72f569 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:18.584306 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-95e5cf81-dbad-4baf-bc2c-ea658f72f569 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1662 microversion: 2.1 time: 0.161810 Aug 04 10:29:18.585426 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 327/618] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:18 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:18.985790 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-3d4f27ba-9a26-4f63-a414-4402c07e9c9e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:18.986477 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-3d4f27ba-9a26-4f63-a414-4402c07e9c9e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:18.992825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3d4f27ba-9a26-4f63-a414-4402c07e9c9e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:18.993266 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3d4f27ba-9a26-4f63-a414-4402c07e9c9e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:18.994041 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3d4f27ba-9a26-4f63-a414-4402c07e9c9e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:18.994467 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3d4f27ba-9a26-4f63-a414-4402c07e9c9e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:19.135645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-3d4f27ba-9a26-4f63-a414-4402c07e9c9e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:19.145206 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-3d4f27ba-9a26-4f63-a414-4402c07e9c9e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1366 microversion: 2.1 time: 0.163450 Aug 04 10:29:19.145933 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 292/619] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:18 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:19.606357 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-54d6bd32-7007-47d7-a211-59ce79349007 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:19.606912 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-54d6bd32-7007-47d7-a211-59ce79349007 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:19.614191 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-54d6bd32-7007-47d7-a211-59ce79349007 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:19.614631 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-54d6bd32-7007-47d7-a211-59ce79349007 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:19.615377 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-54d6bd32-7007-47d7-a211-59ce79349007 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:19.615803 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-54d6bd32-7007-47d7-a211-59ce79349007 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:19.761195 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-54d6bd32-7007-47d7-a211-59ce79349007 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:19.769278 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-54d6bd32-7007-47d7-a211-59ce79349007 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1666 microversion: 2.1 time: 0.166188 Aug 04 10:29:19.769826 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 328/620] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:19 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1666 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:20.172125 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4fa5f8af-92a1-4b42-a2c8-a0579055a9b5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:20.172835 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4fa5f8af-92a1-4b42-a2c8-a0579055a9b5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:20.181144 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4fa5f8af-92a1-4b42-a2c8-a0579055a9b5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:20.181602 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4fa5f8af-92a1-4b42-a2c8-a0579055a9b5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:20.182422 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4fa5f8af-92a1-4b42-a2c8-a0579055a9b5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:20.182945 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4fa5f8af-92a1-4b42-a2c8-a0579055a9b5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:20.316726 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4fa5f8af-92a1-4b42-a2c8-a0579055a9b5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:20.324799 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4fa5f8af-92a1-4b42-a2c8-a0579055a9b5 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1366 microversion: 2.1 time: 0.157173 Aug 04 10:29:20.325412 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 293/621] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:20 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:21.347220 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-04361846-6e15-43f5-ab8a-64dee4e7c333 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:21.347914 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-04361846-6e15-43f5-ab8a-64dee4e7c333 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:21.355146 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04361846-6e15-43f5-ab8a-64dee4e7c333 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:21.355687 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04361846-6e15-43f5-ab8a-64dee4e7c333 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:21.356645 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04361846-6e15-43f5-ab8a-64dee4e7c333 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:21.357115 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-04361846-6e15-43f5-ab8a-64dee4e7c333 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:21.488927 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-04361846-6e15-43f5-ab8a-64dee4e7c333 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:21.496567 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-04361846-6e15-43f5-ab8a-64dee4e7c333 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1366 microversion: 2.1 time: 0.153764 Aug 04 10:29:21.497126 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 329/622] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:21 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:22.504663 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dd5cc9df-793d-45b5-8255-484672066a66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4d0da5b-5e34-465d-a0ee-d57a2a0d4fa9"}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:22.506948 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dd5cc9df-793d-45b5-8255-484672066a66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:22.515027 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dd5cc9df-793d-45b5-8255-484672066a66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:22.515474 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dd5cc9df-793d-45b5-8255-484672066a66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:22.516297 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dd5cc9df-793d-45b5-8255-484672066a66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:22.516486 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-dd911e47-028f-429a-a953-f6d93489b8f1 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:22.516908 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dd5cc9df-793d-45b5-8255-484672066a66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:22.517101 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-dd911e47-028f-429a-a953-f6d93489b8f1 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:22.524206 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dd911e47-028f-429a-a953-f6d93489b8f1 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:22.524660 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dd911e47-028f-429a-a953-f6d93489b8f1 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:22.525427 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dd911e47-028f-429a-a953-f6d93489b8f1 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:22.525863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dd911e47-028f-429a-a953-f6d93489b8f1 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:22.652961 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-dd911e47-028f-429a-a953-f6d93489b8f1 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:22.660324 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-dd911e47-028f-429a-a953-f6d93489b8f1 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1366 microversion: 2.1 time: 0.147526 Aug 04 10:29:22.660889 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 330/623] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:22 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:29:23.682007 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-41f756bf-a14e-4c20-be7e-b01e55c0f767 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:23.682805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-41f756bf-a14e-4c20-be7e-b01e55c0f767 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:23.689703 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-41f756bf-a14e-4c20-be7e-b01e55c0f767 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:23.690190 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-41f756bf-a14e-4c20-be7e-b01e55c0f767 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:23.691637 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-41f756bf-a14e-4c20-be7e-b01e55c0f767 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:23.692184 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-41f756bf-a14e-4c20-be7e-b01e55c0f767 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:23.849582 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-41f756bf-a14e-4c20-be7e-b01e55c0f767 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:23.857457 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-41f756bf-a14e-4c20-be7e-b01e55c0f767 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1366 microversion: 2.1 time: 0.179469 Aug 04 10:29:23.858056 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 331/624] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:23 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:29:23.978897 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-dd5cc9df-793d-45b5-8255-484672066a66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "POST /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.478818 Aug 04 10:29:23.984403 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 294/625] 10.222.0.72 () {60 vars in 1323 bytes} [Thu Aug 4 10:29:22 2022] POST /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-volume_attachments => generated 194 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:29:24.878617 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8b88193b-f182-4e85-b518-5d7c1e60b2bb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:24.879150 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8b88193b-f182-4e85-b518-5d7c1e60b2bb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:24.885652 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8b88193b-f182-4e85-b518-5d7c1e60b2bb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:24.886101 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8b88193b-f182-4e85-b518-5d7c1e60b2bb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:24.886856 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8b88193b-f182-4e85-b518-5d7c1e60b2bb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:24.887286 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8b88193b-f182-4e85-b518-5d7c1e60b2bb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:25.014403 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8b88193b-f182-4e85-b518-5d7c1e60b2bb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:25.022304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8b88193b-f182-4e85-b518-5d7c1e60b2bb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1366 microversion: 2.1 time: 0.147529 Aug 04 10:29:25.022805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 332/626] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:24 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:25.380872 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-557514aa-9afe-40d5-99d9-c1c94c13f34b req-68ecc865-8100-45c2-8eb8-8c60ac3771c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228506d2-27e6-4bab-991d-0695ea9543c3", "name": "network-vif-plugged", "status": "completed", "tag": "adec20b2-5dff-4931-86b4-11c30465304f"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:25.392214 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-557514aa-9afe-40d5-99d9-c1c94c13f34b req-68ecc865-8100-45c2-8eb8-8c60ac3771c9 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:25.392659 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-557514aa-9afe-40d5-99d9-c1c94c13f34b req-68ecc865-8100-45c2-8eb8-8c60ac3771c9 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:25.403642 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-557514aa-9afe-40d5-99d9-c1c94c13f34b req-68ecc865-8100-45c2-8eb8-8c60ac3771c9 service nova] Creating event network-vif-plugged:adec20b2-5dff-4931-86b4-11c30465304f for instance 228506d2-27e6-4bab-991d-0695ea9543c3 on hv-cinder-82660 Aug 04 10:29:25.408359 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-557514aa-9afe-40d5-99d9-c1c94c13f34b req-68ecc865-8100-45c2-8eb8-8c60ac3771c9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031579 Aug 04 10:29:25.408960 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 295/627] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:29:26.042611 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-19e711db-61f6-4734-8ec2-48f7d89fda9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:26.043222 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-19e711db-61f6-4734-8ec2-48f7d89fda9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:26.045139 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:26.051071 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19e711db-61f6-4734-8ec2-48f7d89fda9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:26.051522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19e711db-61f6-4734-8ec2-48f7d89fda9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:26.052313 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19e711db-61f6-4734-8ec2-48f7d89fda9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:26.052747 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19e711db-61f6-4734-8ec2-48f7d89fda9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:26.188591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-19e711db-61f6-4734-8ec2-48f7d89fda9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:26.196871 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-19e711db-61f6-4734-8ec2-48f7d89fda9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1366 microversion: 2.1 time: 0.158121 Aug 04 10:29:26.197443 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 333/628] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:26 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:27.218450 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:27.219372 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=10 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:27.224968 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-04b4a438-6ffe-4539-aa05-f1c5850aed0a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:27.225677 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-04b4a438-6ffe-4539-aa05-f1c5850aed0a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:27.233029 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-04b4a438-6ffe-4539-aa05-f1c5850aed0a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:27.233506 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-04b4a438-6ffe-4539-aa05-f1c5850aed0a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:27.234297 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-04b4a438-6ffe-4539-aa05-f1c5850aed0a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:27.234745 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-04b4a438-6ffe-4539-aa05-f1c5850aed0a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:27.365212 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-04b4a438-6ffe-4539-aa05-f1c5850aed0a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:27.372613 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-04b4a438-6ffe-4539-aa05-f1c5850aed0a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1366 microversion: 2.1 time: 0.155145 Aug 04 10:29:27.373176 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 296/629] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:27 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:28.393655 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2a71a728-b04d-4371-958c-78f8deb0043c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:28.394265 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2a71a728-b04d-4371-958c-78f8deb0043c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:28.400795 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a71a728-b04d-4371-958c-78f8deb0043c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:28.401246 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a71a728-b04d-4371-958c-78f8deb0043c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:28.402022 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a71a728-b04d-4371-958c-78f8deb0043c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:28.402453 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2a71a728-b04d-4371-958c-78f8deb0043c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:28.537871 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2a71a728-b04d-4371-958c-78f8deb0043c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:28.545386 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2a71a728-b04d-4371-958c-78f8deb0043c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1557 microversion: 2.1 time: 0.155678 Aug 04 10:29:28.545950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 334/630] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:28 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:28.566031 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d48625ce-ff25-4d16-b004-0e7886154c11 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:28.566579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-d48625ce-ff25-4d16-b004-0e7886154c11 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:28.572966 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d48625ce-ff25-4d16-b004-0e7886154c11 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:28.573405 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d48625ce-ff25-4d16-b004-0e7886154c11 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:28.574152 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d48625ce-ff25-4d16-b004-0e7886154c11 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:28.574577 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d48625ce-ff25-4d16-b004-0e7886154c11 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:28.654084 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d48625ce-ff25-4d16-b004-0e7886154c11 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091880 Aug 04 10:29:28.654678 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 297/631] 10.222.0.72 () {58 vars in 1275 bytes} [Thu Aug 4 10:29:28 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:29:29.797371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-1387188d-e50b-4816-bdb7-1cec5caedbef req-f356a9b8-7d5a-4a32-88bb-158b6da7fed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228506d2-27e6-4bab-991d-0695ea9543c3", "tag": "adec20b2-5dff-4931-86b4-11c30465304f"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:29.808133 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-1387188d-e50b-4816-bdb7-1cec5caedbef req-f356a9b8-7d5a-4a32-88bb-158b6da7fed3 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:29.808314 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-1387188d-e50b-4816-bdb7-1cec5caedbef req-f356a9b8-7d5a-4a32-88bb-158b6da7fed3 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:29.821252 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-1387188d-e50b-4816-bdb7-1cec5caedbef req-f356a9b8-7d5a-4a32-88bb-158b6da7fed3 service nova] Creating event network-changed:adec20b2-5dff-4931-86b4-11c30465304f for instance 228506d2-27e6-4bab-991d-0695ea9543c3 on hv-cinder-82660 Aug 04 10:29:29.830181 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-1387188d-e50b-4816-bdb7-1cec5caedbef req-f356a9b8-7d5a-4a32-88bb-158b6da7fed3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037337 Aug 04 10:29:29.831046 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 335/632] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:29:31.529359 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f0a5ddee-1cb9-41a4-89fe-d112c1581e32 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:31.531597 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f0a5ddee-1cb9-41a4-89fe-d112c1581e32 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:31.537943 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f0a5ddee-1cb9-41a4-89fe-d112c1581e32 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:31.538417 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f0a5ddee-1cb9-41a4-89fe-d112c1581e32 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:31.539177 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f0a5ddee-1cb9-41a4-89fe-d112c1581e32 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:31.539641 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f0a5ddee-1cb9-41a4-89fe-d112c1581e32 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:31.563135 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-f0a5ddee-1cb9-41a4-89fe-d112c1581e32 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lazy-loading 'flavor' on Instance uuid fd2293ba-55aa-43f6-a08d-06a3995d3fda {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:29:31.692151 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f0a5ddee-1cb9-41a4-89fe-d112c1581e32 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "POST /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/action" status: 200 len: 32 microversion: 2.1 time: 0.167150 Aug 04 10:29:31.692758 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 298/633] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:29:31 2022] POST /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:29:31.703142 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6ac7b56d-c20d-45b3-a4ae-1d5bf671036f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:31.703975 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6ac7b56d-c20d-45b3-a4ae-1d5bf671036f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:31.710522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6ac7b56d-c20d-45b3-a4ae-1d5bf671036f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:31.711051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6ac7b56d-c20d-45b3-a4ae-1d5bf671036f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:31.711914 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6ac7b56d-c20d-45b3-a4ae-1d5bf671036f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:31.712406 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6ac7b56d-c20d-45b3-a4ae-1d5bf671036f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:31.848684 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6ac7b56d-c20d-45b3-a4ae-1d5bf671036f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:31.857137 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6ac7b56d-c20d-45b3-a4ae-1d5bf671036f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.158668 Aug 04 10:29:31.857812 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 336/634] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:31 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:32.880249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dada5ea4-1493-428e-828b-761da4ee7117 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:32.880968 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dada5ea4-1493-428e-828b-761da4ee7117 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:32.887247 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dada5ea4-1493-428e-828b-761da4ee7117 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:32.887636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dada5ea4-1493-428e-828b-761da4ee7117 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:32.888423 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dada5ea4-1493-428e-828b-761da4ee7117 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:32.888868 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dada5ea4-1493-428e-828b-761da4ee7117 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:33.019680 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-dada5ea4-1493-428e-828b-761da4ee7117 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:33.027801 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-dada5ea4-1493-428e-828b-761da4ee7117 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.152899 Aug 04 10:29:33.028394 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 299/635] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:32 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:34.048869 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9b0ecc6f-5ec0-4c05-8914-fd81341c2777 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:34.049491 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9b0ecc6f-5ec0-4c05-8914-fd81341c2777 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:34.056270 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9b0ecc6f-5ec0-4c05-8914-fd81341c2777 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:34.056725 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9b0ecc6f-5ec0-4c05-8914-fd81341c2777 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:34.057510 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9b0ecc6f-5ec0-4c05-8914-fd81341c2777 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:34.057947 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9b0ecc6f-5ec0-4c05-8914-fd81341c2777 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:34.192931 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9b0ecc6f-5ec0-4c05-8914-fd81341c2777 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:34.201172 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9b0ecc6f-5ec0-4c05-8914-fd81341c2777 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.156210 Aug 04 10:29:34.201750 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 337/636] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:34 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:35.223876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8776f4a1-12f5-4a4b-87d7-4cdfeac44464 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:35.224652 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8776f4a1-12f5-4a4b-87d7-4cdfeac44464 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:35.227264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:35.233121 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8776f4a1-12f5-4a4b-87d7-4cdfeac44464 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:35.233568 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8776f4a1-12f5-4a4b-87d7-4cdfeac44464 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:35.234337 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8776f4a1-12f5-4a4b-87d7-4cdfeac44464 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:35.234773 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8776f4a1-12f5-4a4b-87d7-4cdfeac44464 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:35.378706 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8776f4a1-12f5-4a4b-87d7-4cdfeac44464 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:35.386665 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8776f4a1-12f5-4a4b-87d7-4cdfeac44464 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.167325 Aug 04 10:29:35.387229 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 300/637] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:35 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:36.408122 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8655228e-e158-41ba-a5f9-7ef15bbcc4a7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:36.408729 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8655228e-e158-41ba-a5f9-7ef15bbcc4a7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:36.415421 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8655228e-e158-41ba-a5f9-7ef15bbcc4a7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:36.415873 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8655228e-e158-41ba-a5f9-7ef15bbcc4a7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:36.416680 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8655228e-e158-41ba-a5f9-7ef15bbcc4a7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:36.417118 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8655228e-e158-41ba-a5f9-7ef15bbcc4a7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:36.548590 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8655228e-e158-41ba-a5f9-7ef15bbcc4a7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:36.557420 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8655228e-e158-41ba-a5f9-7ef15bbcc4a7 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.153202 Aug 04 10:29:36.557977 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 338/638] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:36 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:37.578562 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-aabe3a41-9657-4b46-9fdd-8368a7755f57 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:37.579160 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-aabe3a41-9657-4b46-9fdd-8368a7755f57 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:37.586483 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-aabe3a41-9657-4b46-9fdd-8368a7755f57 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:37.587150 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-aabe3a41-9657-4b46-9fdd-8368a7755f57 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:37.587704 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-aabe3a41-9657-4b46-9fdd-8368a7755f57 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:37.588161 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-aabe3a41-9657-4b46-9fdd-8368a7755f57 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:37.717066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-aabe3a41-9657-4b46-9fdd-8368a7755f57 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:37.724799 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-aabe3a41-9657-4b46-9fdd-8368a7755f57 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.150149 Aug 04 10:29:37.725352 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 301/639] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:37 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:38.746358 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d5a93248-2178-4f4b-af56-fb95ba418fee tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:38.746949 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d5a93248-2178-4f4b-af56-fb95ba418fee tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:38.754210 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5a93248-2178-4f4b-af56-fb95ba418fee tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:38.754653 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5a93248-2178-4f4b-af56-fb95ba418fee tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:38.755416 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5a93248-2178-4f4b-af56-fb95ba418fee tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:38.755871 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5a93248-2178-4f4b-af56-fb95ba418fee tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:38.886687 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d5a93248-2178-4f4b-af56-fb95ba418fee tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:38.895157 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d5a93248-2178-4f4b-af56-fb95ba418fee tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.152755 Aug 04 10:29:38.895726 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 339/640] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:38 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:39.916014 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e6997bea-21ec-402b-ae40-156db5e46646 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:39.916621 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e6997bea-21ec-402b-ae40-156db5e46646 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:39.923198 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e6997bea-21ec-402b-ae40-156db5e46646 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:39.923647 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e6997bea-21ec-402b-ae40-156db5e46646 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:39.924433 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e6997bea-21ec-402b-ae40-156db5e46646 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:39.925133 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e6997bea-21ec-402b-ae40-156db5e46646 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:40.050941 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e6997bea-21ec-402b-ae40-156db5e46646 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:40.058771 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e6997bea-21ec-402b-ae40-156db5e46646 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.146621 Aug 04 10:29:40.059385 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 302/641] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:39 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:41.079908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-be0c601d-2955-4f8a-8b3c-e035cd70abbb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:41.080492 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-be0c601d-2955-4f8a-8b3c-e035cd70abbb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:41.087466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-be0c601d-2955-4f8a-8b3c-e035cd70abbb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:41.087924 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-be0c601d-2955-4f8a-8b3c-e035cd70abbb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:41.088751 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-be0c601d-2955-4f8a-8b3c-e035cd70abbb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:41.089186 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-be0c601d-2955-4f8a-8b3c-e035cd70abbb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:41.218607 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-be0c601d-2955-4f8a-8b3c-e035cd70abbb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:41.227076 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-be0c601d-2955-4f8a-8b3c-e035cd70abbb tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.151158 Aug 04 10:29:41.227643 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 340/642] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:41 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:42.249439 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-18a01ff0-3dc7-4bde-98e2-d119e4c8a7f8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:42.249835 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-18a01ff0-3dc7-4bde-98e2-d119e4c8a7f8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:42.256767 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-18a01ff0-3dc7-4bde-98e2-d119e4c8a7f8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:42.257208 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-18a01ff0-3dc7-4bde-98e2-d119e4c8a7f8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:42.257969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-18a01ff0-3dc7-4bde-98e2-d119e4c8a7f8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:42.258404 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-18a01ff0-3dc7-4bde-98e2-d119e4c8a7f8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:42.388965 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-18a01ff0-3dc7-4bde-98e2-d119e4c8a7f8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:42.397007 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-18a01ff0-3dc7-4bde-98e2-d119e4c8a7f8 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.151916 Aug 04 10:29:42.397574 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 303/643] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:42 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:43.273885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-097854a6-8175-4327-af34-ce1a77a0b049 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:43.274387 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-097854a6-8175-4327-af34-ce1a77a0b049 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:43.280832 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-097854a6-8175-4327-af34-ce1a77a0b049 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:43.281271 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-097854a6-8175-4327-af34-ce1a77a0b049 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:43.282043 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-097854a6-8175-4327-af34-ce1a77a0b049 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:43.282470 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-097854a6-8175-4327-af34-ce1a77a0b049 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:43.310806 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-097854a6-8175-4327-af34-ce1a77a0b049 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/os-volume_attachments/3c7f6a4f-bfb6-4457-9de7-593cf7b5df3f" status: 200 len: 194 microversion: 2.20 time: 0.041689 Aug 04 10:29:43.311386 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 341/644] 10.222.0.72 () {60 vars in 1454 bytes} [Thu Aug 4 10:29:43 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/os-volume_attachments/3c7f6a4f-bfb6-4457-9de7-593cf7b5df3f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:29:43.376017 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-41ab19e2-5f92-436f-b072-ad2d1748c18f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:43.376508 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-41ab19e2-5f92-436f-b072-ad2d1748c18f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:43.383451 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-41ab19e2-5f92-436f-b072-ad2d1748c18f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:43.383896 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-41ab19e2-5f92-436f-b072-ad2d1748c18f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:43.384683 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-41ab19e2-5f92-436f-b072-ad2d1748c18f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:43.385113 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-41ab19e2-5f92-436f-b072-ad2d1748c18f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:43.417626 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-13e47878-4e93-4234-a740-306b79a5d0da tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:43.418232 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-13e47878-4e93-4234-a740-306b79a5d0da tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:43.424275 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13e47878-4e93-4234-a740-306b79a5d0da tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:43.424731 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13e47878-4e93-4234-a740-306b79a5d0da tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:43.425776 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13e47878-4e93-4234-a740-306b79a5d0da tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:43.426209 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-13e47878-4e93-4234-a740-306b79a5d0da tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:43.441279 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:43.466026 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-41ab19e2-5f92-436f-b072-ad2d1748c18f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lazy-loading 'services' on Instance uuid 0396f5e6-1b64-4b0f-9352-28165af5878b {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:29:43.528245 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:43.540905 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-41ab19e2-5f92-436f-b072-ad2d1748c18f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/os-volume_attachments/3c7f6a4f-bfb6-4457-9de7-593cf7b5df3f" status: 202 len: 0 microversion: 2.20 time: 0.168632 Aug 04 10:29:43.544711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 304/645] 10.222.0.72 () {60 vars in 1457 bytes} [Thu Aug 4 10:29:43 2022] DELETE /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/os-volume_attachments/3c7f6a4f-bfb6-4457-9de7-593cf7b5df3f => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:29:43.550344 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7c397a37-ae64-4711-93ba-6fab16b58fa8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:43.552713 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7c397a37-ae64-4711-93ba-6fab16b58fa8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:43.559778 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7c397a37-ae64-4711-93ba-6fab16b58fa8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:43.560291 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7c397a37-ae64-4711-93ba-6fab16b58fa8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:43.561125 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7c397a37-ae64-4711-93ba-6fab16b58fa8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:43.561607 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7c397a37-ae64-4711-93ba-6fab16b58fa8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:43.567477 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-13e47878-4e93-4234-a740-306b79a5d0da tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:43.575812 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-13e47878-4e93-4234-a740-306b79a5d0da tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.161940 Aug 04 10:29:43.587979 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 342/646] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:43 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:29:43.593344 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7c397a37-ae64-4711-93ba-6fab16b58fa8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047306 Aug 04 10:29:43.594262 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 305/647] 10.222.0.72 () {60 vars in 1343 bytes} [Thu Aug 4 10:29:43 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:29:44.599203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fa08363a-1276-4519-b322-4e8fc6be50e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:44.599927 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fa08363a-1276-4519-b322-4e8fc6be50e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:44.606153 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-521529e0-5a67-4c63-90cf-e58fd8f9fe8d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:44.606953 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fa08363a-1276-4519-b322-4e8fc6be50e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:44.607399 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fa08363a-1276-4519-b322-4e8fc6be50e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:44.608208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fa08363a-1276-4519-b322-4e8fc6be50e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:44.608583 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-521529e0-5a67-4c63-90cf-e58fd8f9fe8d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:44.608682 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fa08363a-1276-4519-b322-4e8fc6be50e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:44.614975 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-521529e0-5a67-4c63-90cf-e58fd8f9fe8d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:44.615415 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-521529e0-5a67-4c63-90cf-e58fd8f9fe8d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:44.616215 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-521529e0-5a67-4c63-90cf-e58fd8f9fe8d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:44.616649 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-521529e0-5a67-4c63-90cf-e58fd8f9fe8d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:44.646049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-521529e0-5a67-4c63-90cf-e58fd8f9fe8d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043794 Aug 04 10:29:44.646612 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 306/648] 10.222.0.72 () {60 vars in 1343 bytes} [Thu Aug 4 10:29:44 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:29:44.715746 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7231a81e-2fed-4efe-987a-d6f8eb629cc4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:44.716307 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7231a81e-2fed-4efe-987a-d6f8eb629cc4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:44.722933 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7231a81e-2fed-4efe-987a-d6f8eb629cc4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:44.723357 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7231a81e-2fed-4efe-987a-d6f8eb629cc4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:44.724254 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7231a81e-2fed-4efe-987a-d6f8eb629cc4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:44.724689 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7231a81e-2fed-4efe-987a-d6f8eb629cc4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:44.747266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fa08363a-1276-4519-b322-4e8fc6be50e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:44.749057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7231a81e-2fed-4efe-987a-d6f8eb629cc4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Going to try to terminate instance {{(pid=117667) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:29:44.755823 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fa08363a-1276-4519-b322-4e8fc6be50e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.161141 Aug 04 10:29:44.756441 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 343/649] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:44 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:44.825583 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7231a81e-2fed-4efe-987a-d6f8eb629cc4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 204 len: 0 microversion: 2.20 time: 0.113937 Aug 04 10:29:44.826171 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 307/650] 10.222.0.72 () {60 vars in 1280 bytes} [Thu Aug 4 10:29:44 2022] DELETE /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 10:29:44.835519 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-434445bb-21bb-4ee5-bd8a-ae5d751e576d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:44.836149 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-434445bb-21bb-4ee5-bd8a-ae5d751e576d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:44.842326 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-434445bb-21bb-4ee5-bd8a-ae5d751e576d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:44.842773 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-434445bb-21bb-4ee5-bd8a-ae5d751e576d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:44.843537 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-434445bb-21bb-4ee5-bd8a-ae5d751e576d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:44.843990 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-434445bb-21bb-4ee5-bd8a-ae5d751e576d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:44.971584 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-434445bb-21bb-4ee5-bd8a-ae5d751e576d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:44.979517 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-434445bb-21bb-4ee5-bd8a-ae5d751e576d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:44.981053 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-434445bb-21bb-4ee5-bd8a-ae5d751e576d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:44.982187 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-434445bb-21bb-4ee5-bd8a-ae5d751e576d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.151426 Aug 04 10:29:44.982746 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 344/651] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:29:44 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:29:45.778393 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5a19b68c-37f1-44ce-abb1-60b690f478a2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:45.779086 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5a19b68c-37f1-44ce-abb1-60b690f478a2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:45.786174 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a19b68c-37f1-44ce-abb1-60b690f478a2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:45.786620 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a19b68c-37f1-44ce-abb1-60b690f478a2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:45.787370 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a19b68c-37f1-44ce-abb1-60b690f478a2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:45.787807 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a19b68c-37f1-44ce-abb1-60b690f478a2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:45.922122 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5a19b68c-37f1-44ce-abb1-60b690f478a2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:45.930176 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5a19b68c-37f1-44ce-abb1-60b690f478a2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.156127 Aug 04 10:29:45.930741 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 308/652] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:45 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:46.004544 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-31cf06b7-725d-43dc-8de5-140ef76cad33 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:46.005151 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-31cf06b7-725d-43dc-8de5-140ef76cad33 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:46.011570 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-31cf06b7-725d-43dc-8de5-140ef76cad33 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:46.012059 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-31cf06b7-725d-43dc-8de5-140ef76cad33 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:46.012846 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-31cf06b7-725d-43dc-8de5-140ef76cad33 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:46.013282 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-31cf06b7-725d-43dc-8de5-140ef76cad33 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:46.153710 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-31cf06b7-725d-43dc-8de5-140ef76cad33 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:46.161699 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-31cf06b7-725d-43dc-8de5-140ef76cad33 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:46.163197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-31cf06b7-725d-43dc-8de5-140ef76cad33 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:46.164503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-31cf06b7-725d-43dc-8de5-140ef76cad33 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1724 microversion: 2.20 time: 0.163691 Aug 04 10:29:46.165061 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 345/653] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:29:45 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:29:46.950753 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c69d7dd4-5b4d-41e6-a5d8-caab60581c66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:46.951379 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c69d7dd4-5b4d-41e6-a5d8-caab60581c66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:46.958484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c69d7dd4-5b4d-41e6-a5d8-caab60581c66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:46.958923 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c69d7dd4-5b4d-41e6-a5d8-caab60581c66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:46.959682 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c69d7dd4-5b4d-41e6-a5d8-caab60581c66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:46.960136 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c69d7dd4-5b4d-41e6-a5d8-caab60581c66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:47.090147 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c69d7dd4-5b4d-41e6-a5d8-caab60581c66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:47.098799 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c69d7dd4-5b4d-41e6-a5d8-caab60581c66 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.151965 Aug 04 10:29:47.099573 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 309/654] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:46 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:47.193179 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c16a2435-2886-4b4c-8fd5-f0512ccc3ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:47.194107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c16a2435-2886-4b4c-8fd5-f0512ccc3ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:47.201627 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c16a2435-2886-4b4c-8fd5-f0512ccc3ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:47.202025 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c16a2435-2886-4b4c-8fd5-f0512ccc3ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:47.202772 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c16a2435-2886-4b4c-8fd5-f0512ccc3ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:47.203202 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c16a2435-2886-4b4c-8fd5-f0512ccc3ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:47.271360 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c16a2435-2886-4b4c-8fd5-f0512ccc3ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:47.279517 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c16a2435-2886-4b4c-8fd5-f0512ccc3ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:47.281061 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c16a2435-2886-4b4c-8fd5-f0512ccc3ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:47.282211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c16a2435-2886-4b4c-8fd5-f0512ccc3ae4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1657 microversion: 2.20 time: 0.096896 Aug 04 10:29:47.282769 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 346/655] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:29:47 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1657 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:29:47.445345 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-8f08a177-8abf-4a62-ac30-a88fc5a7084b req-523a6921-d19e-4e4e-b550-596fd140b28d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0396f5e6-1b64-4b0f-9352-28165af5878b", "name": "network-vif-deleted", "tag": "46e7bd28-a5a1-4c48-aa21-1a4902096c91"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:47.458949 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-8f08a177-8abf-4a62-ac30-a88fc5a7084b req-523a6921-d19e-4e4e-b550-596fd140b28d service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:47.459313 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-8f08a177-8abf-4a62-ac30-a88fc5a7084b req-523a6921-d19e-4e4e-b550-596fd140b28d service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:47.471474 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-8f08a177-8abf-4a62-ac30-a88fc5a7084b req-523a6921-d19e-4e4e-b550-596fd140b28d service nova] Creating event network-vif-deleted:46e7bd28-a5a1-4c48-aa21-1a4902096c91 for instance 0396f5e6-1b64-4b0f-9352-28165af5878b on hv-cinder-82660 Aug 04 10:29:47.477031 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-8f08a177-8abf-4a62-ac30-a88fc5a7084b req-523a6921-d19e-4e4e-b550-596fd140b28d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036615 Aug 04 10:29:47.481038 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 310/656] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:29:48.119858 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-44391641-90e5-4966-931d-453211f759fe tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:48.120619 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-44391641-90e5-4966-931d-453211f759fe tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:48.122528 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=42 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:48.128148 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-44391641-90e5-4966-931d-453211f759fe tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:48.128601 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-44391641-90e5-4966-931d-453211f759fe tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:48.129359 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-44391641-90e5-4966-931d-453211f759fe tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:48.129783 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-44391641-90e5-4966-931d-453211f759fe tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:48.263772 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-44391641-90e5-4966-931d-453211f759fe tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:48.272812 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-44391641-90e5-4966-931d-453211f759fe tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.156720 Aug 04 10:29:48.273489 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 347/657] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:48 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:48.306886 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d3591a62-7b86-4b14-a961-b3f6308f62f5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:48.307587 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-d3591a62-7b86-4b14-a961-b3f6308f62f5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:48.313788 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d3591a62-7b86-4b14-a961-b3f6308f62f5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:48.314231 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d3591a62-7b86-4b14-a961-b3f6308f62f5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:48.314976 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d3591a62-7b86-4b14-a961-b3f6308f62f5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:48.315403 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d3591a62-7b86-4b14-a961-b3f6308f62f5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:48.346335 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d3591a62-7b86-4b14-a961-b3f6308f62f5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:48.346770 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d3591a62-7b86-4b14-a961-b3f6308f62f5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:48.348020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-d3591a62-7b86-4b14-a961-b3f6308f62f5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lazy-loading 'fault' on Instance uuid 0396f5e6-1b64-4b0f-9352-28165af5878b {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:29:48.395086 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d3591a62-7b86-4b14-a961-b3f6308f62f5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:48.404390 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d3591a62-7b86-4b14-a961-b3f6308f62f5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:48.405875 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d3591a62-7b86-4b14-a961-b3f6308f62f5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:48.407024 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d3591a62-7b86-4b14-a961-b3f6308f62f5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 200 len: 1371 microversion: 2.20 time: 0.105268 Aug 04 10:29:48.407584 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 311/658] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:29:48 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:29:49.295407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-efa81ccf-6fa7-4ff0-afe8-06871c3bf129 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:49.296214 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-efa81ccf-6fa7-4ff0-afe8-06871c3bf129 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:49.303615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-efa81ccf-6fa7-4ff0-afe8-06871c3bf129 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:49.304087 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-efa81ccf-6fa7-4ff0-afe8-06871c3bf129 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:49.304857 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-efa81ccf-6fa7-4ff0-afe8-06871c3bf129 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:49.305290 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-efa81ccf-6fa7-4ff0-afe8-06871c3bf129 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:49.431264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a545e7e2-d1f1-458c-8c1c-8462244861b5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:49.431870 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a545e7e2-d1f1-458c-8c1c-8462244861b5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:49.438368 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a545e7e2-d1f1-458c-8c1c-8462244861b5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:49.438822 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a545e7e2-d1f1-458c-8c1c-8462244861b5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:49.439590 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a545e7e2-d1f1-458c-8c1c-8462244861b5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:49.440051 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a545e7e2-d1f1-458c-8c1c-8462244861b5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:49.440355 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-efa81ccf-6fa7-4ff0-afe8-06871c3bf129 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:49.448570 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-efa81ccf-6fa7-4ff0-afe8-06871c3bf129 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.157707 Aug 04 10:29:49.449132 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 348/659] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:49 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:49.453407 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-a545e7e2-d1f1-458c-8c1c-8462244861b5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] HTTP exception thrown: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a545e7e2-d1f1-458c-8c1c-8462244861b5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Request method failure captured: Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b HTTP/1.1 Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656SwTM9jFF0y2HhOYUn9XpqxKP43wqAawwvL-y7y22HyJSYp7A-f0tgbKreB7IFdOsNuEgaHRVERhzxBQUTeQlMJ_xKlABcQbIlqX3JwrfHnXs9q-HdNbNMEADiKM1m5QOSljzTqvMb6XvkaXCKQ_yEUKGvZ-quN7FtPVDZ57C5CoI Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 35576cef915b41419fc74b0beea0f988 Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:29:49.455059 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:29:49.456707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/35576cef915b41419fc74b0beea0f988"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/35576cef915b41419fc74b0beea0f988"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/35576cef915b41419fc74b0beea0f988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_35576cef915b41419fc74b0beea0f988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:29:49.456707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:29:49.456707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 35576cef915b41419fc74b0beea0f988 Aug 04 10:29:49.456707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:29:49.456707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-AttachVolumeShelveTestJSON-791276795-project Aug 04 10:29:49.456707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:29:49.456707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:29:49.456707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: 7213149649d249f2b2da3d6c7dac0a68 Aug 04 10:29:49.456707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791276795-project Aug 04 10:29:49.456707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:29:49.456707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:29:49.456707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '0396f5e6-1b64-4b0f-9352-28165af5878b'} Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:29:49.457555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:29:49.458906 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:29:49.460795 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a545e7e2-d1f1-458c-8c1c-8462244861b5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Returning 404 to user: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:29:49.460795 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a545e7e2-d1f1-458c-8c1c-8462244861b5 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 404 len: 111 microversion: 2.20 time: 0.029094 Aug 04 10:29:49.460795 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 312/660] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:29:49 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 10:29:49.465476 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e4a86e97-57aa-4801-ab06-d4bf2a1d709c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '.version_select at 0x7fbaa4e99e50>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:49.484583 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e4a86e97-57aa-4801-ab06-d4bf2a1d709c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2001758252" status: 204 len: 0 microversion: 2.20 time: 0.023028 Aug 04 10:29:49.485143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 349/661] 10.222.0.72 () {60 vars in 1262 bytes} [Thu Aug 4 10:29:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2001758252 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 10:29:50.101165 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-330b9dfc-f0a9-43b2-9f38-bc8fc8963a77 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Action: 'create', calling method: .version_select at 0x7fbaa46e45e0>, body: {"keypair": {"name": "tempest-keypair-1200881194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNML24dtGc+8AFX+jIzfK2uI76C4B6Gjf+m2sGdM+7kcaF2mOx1T+30Xv2MS9bWP/8P0plRmbJ6Fj+HVKZADFtzEBtXU7gr70f6kIXjfvLtmYptuDne+rMhTY0540r2tYA=="}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:50.116218 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-330b9dfc-f0a9-43b2-9f38-bc8fc8963a77 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Getting quotas for project 35576cef915b41419fc74b0beea0f988. Resources: {'key_pairs'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:29:50.120037 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-330b9dfc-f0a9-43b2-9f38-bc8fc8963a77 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Getting quotas for user 7213149649d249f2b2da3d6c7dac0a68 and project 35576cef915b41419fc74b0beea0f988. Resources: {'key_pairs'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:29:50.141960 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-330b9dfc-f0a9-43b2-9f38-bc8fc8963a77 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044662 Aug 04 10:29:50.142538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 313/662] 10.222.0.72 () {62 vars in 1200 bytes} [Thu Aug 4 10:29:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 10:29:50.470248 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-997d026f-4766-4072-b101-db9dcca3c389 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:50.470854 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-997d026f-4766-4072-b101-db9dcca3c389 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:50.477547 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-997d026f-4766-4072-b101-db9dcca3c389 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:50.477999 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-997d026f-4766-4072-b101-db9dcca3c389 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:50.478765 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-997d026f-4766-4072-b101-db9dcca3c389 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:50.479199 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-997d026f-4766-4072-b101-db9dcca3c389 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:50.700813 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-997d026f-4766-4072-b101-db9dcca3c389 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:50.708706 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-997d026f-4766-4072-b101-db9dcca3c389 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1734 microversion: 2.1 time: 0.242858 Aug 04 10:29:50.709270 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 350/663] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:50 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1734 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:51.533089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1359619130", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb532c69-9dbe-4e1f-90c6-af7f1f84969a"}], "security_groups": [{"name": "tempest-securitygroup--1470147541"}], "key_name": "tempest-keypair-1200881194", "user_data": "}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:51.636139 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.network.neutron [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] validate_networks() for [('cb532c69-9dbe-4e1f-90c6-af7f1f84969a', None, None, None, None, None)] {{(pid=117667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:29:51.729946 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6598e16f-969b-48a4-acde-b24d14a154b6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:51.730490 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6598e16f-969b-48a4-acde-b24d14a154b6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:51.736979 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6598e16f-969b-48a4-acde-b24d14a154b6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:51.737424 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6598e16f-969b-48a4-acde-b24d14a154b6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:51.738186 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6598e16f-969b-48a4-acde-b24d14a154b6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:51.738619 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6598e16f-969b-48a4-acde-b24d14a154b6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:52.167103 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6598e16f-969b-48a4-acde-b24d14a154b6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:52.175287 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6598e16f-969b-48a4-acde-b24d14a154b6 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1714 microversion: 2.1 time: 0.449070 Aug 04 10:29:52.175853 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 351/664] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:51 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1714 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:29:52.283032 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Flavor limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:29:52.283458 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Image limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:29:52.283937 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Flavor pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:29:52.284487 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Image pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:29:52.284908 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:29:52.288447 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-855e5b0b-dd8f-4e2a-91a8-c30abe5cfb6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:52.288942 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-855e5b0b-dd8f-4e2a-91a8-c30abe5cfb6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:52.294548 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:52.294886 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-855e5b0b-dd8f-4e2a-91a8-c30abe5cfb6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:52.295001 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:52.295332 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-855e5b0b-dd8f-4e2a-91a8-c30abe5cfb6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:52.295776 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:52.296153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-855e5b0b-dd8f-4e2a-91a8-c30abe5cfb6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:52.296259 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:52.296594 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-855e5b0b-dd8f-4e2a-91a8-c30abe5cfb6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:52.313626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Getting quotas for project 35576cef915b41419fc74b0beea0f988. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:29:52.317584 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Getting quotas for user 7213149649d249f2b2da3d6c7dac0a68 and project 35576cef915b41419fc74b0beea0f988. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:29:52.328619 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Going to run 1 instances... {{(pid=117667) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:29:52.330882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:29:52.377754 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-855e5b0b-dd8f-4e2a-91a8-c30abe5cfb6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] HTTP exception thrown: Cannot 'detach_volume' instance fd2293ba-55aa-43f6-a08d-06a3995d3fda while it is in vm_state rescued Aug 04 10:29:52.377986 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9993b46a-305b-4d08-9bc5-e1a40a1c7106 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.849693 Aug 04 10:29:52.384779 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 314/665] 10.222.0.72 () {62 vars in 1188 bytes} [Thu Aug 4 10:29:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-855e5b0b-dd8f-4e2a-91a8-c30abe5cfb6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Request method failure captured: Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-volume_attachments/b4d0da5b-5e34-465d-a0ee-d57a2a0d4fa9 HTTP/1.1 Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656KqkyTpFin9pC6UUiZnxPdZxrNgZe8aKP2AQVBxtFZQjEPDOz2syoeapzmVECDJuwBzARYqZ1ypET-oDIEGI9g04Puz4edhq-MbhP7Na3of1Dv53H-wKi9amzmFumCavdT1HtBnGsw9vziY0TeEZywE9bNtJErPNB1ve5PDfuHqpw Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 2a801dbffe56474d96c2abea31fd2fdc Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:29:52.384964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:29:52.386402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:29:52.386402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:29:52.386402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 2a801dbffe56474d96c2abea31fd2fdc Aug 04 10:29:52.386402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:29:52.386402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-ServerRescueNegativeTestJSON-532732172-project Aug 04 10:29:52.386402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:29:52.386402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:29:52.386402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: 84b748f30ebc4c5aa2af6ddcd86037cd Aug 04 10:29:52.386402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-ServerRescueNegativeTestJSON-532732172-project Aug 04 10:29:52.386402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:29:52.386402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Cannot 'detach_volume' instance fd2293ba-55aa-43f6-a08d-06a3995d3fda while it is in vm_state rescued Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'server_id': 'fd2293ba-55aa-43f6-a08d-06a3995d3fda', 'id': 'b4d0da5b-5e34-465d-a0ee-d57a2a0d4fa9'} Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fd2293ba-55aa-43f6-a08d-06a3995d3fda in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:29:52.387247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fd2293ba-55aa-43f6-a08d-06a3995d3fda while it is in vm_state rescued Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fd2293ba-55aa-43f6-a08d-06a3995d3fda while it is in vm_state rescued Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:29:52.388577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-855e5b0b-dd8f-4e2a-91a8-c30abe5cfb6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Returning 409 to user: Cannot 'detach_volume' instance fd2293ba-55aa-43f6-a08d-06a3995d3fda while it is in vm_state rescued {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:29:52.389705 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-855e5b0b-dd8f-4e2a-91a8-c30abe5cfb6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "DELETE /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-volume_attachments/b4d0da5b-5e34-465d-a0ee-d57a2a0d4fa9" status: 409 len: 152 microversion: 2.1 time: 0.097174 Aug 04 10:29:52.389705 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 352/666] 10.222.0.72 () {58 vars in 1416 bytes} [Thu Aug 4 10:29:52 2022] DELETE /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-volume_attachments/b4d0da5b-5e34-465d-a0ee-d57a2a0d4fa9 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 10:29:52.389875 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-2451306a-6a74-4aff-8f41-756ad3a2e283 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:52.390425 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-2451306a-6a74-4aff-8f41-756ad3a2e283 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:52.392701 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-53475fd6-9e9b-422f-8a90-c97fb7b93e30 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:52.393388 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-53475fd6-9e9b-422f-8a90-c97fb7b93e30 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:52.398202 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2451306a-6a74-4aff-8f41-756ad3a2e283 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:52.398745 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2451306a-6a74-4aff-8f41-756ad3a2e283 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:52.399698 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2451306a-6a74-4aff-8f41-756ad3a2e283 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:52.400162 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2451306a-6a74-4aff-8f41-756ad3a2e283 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:52.456221 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-53475fd6-9e9b-422f-8a90-c97fb7b93e30 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:52.464838 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-53475fd6-9e9b-422f-8a90-c97fb7b93e30 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:52.466473 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-53475fd6-9e9b-422f-8a90-c97fb7b93e30 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:52.467942 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-53475fd6-9e9b-422f-8a90-c97fb7b93e30 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1282 microversion: 2.20 time: 0.081068 Aug 04 10:29:52.468915 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 353/667] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:29:52 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1282 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:29:52.480220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-2451306a-6a74-4aff-8f41-756ad3a2e283 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "POST /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/action" status: 202 len: 0 microversion: 2.1 time: 0.085270 Aug 04 10:29:52.480220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 315/668] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:29:52 2022] POST /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:29:52.488514 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-11a11f2d-4b5b-48cb-8d8a-acf6662de0e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:52.489961 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-11a11f2d-4b5b-48cb-8d8a-acf6662de0e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:52.499288 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-11a11f2d-4b5b-48cb-8d8a-acf6662de0e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:52.499675 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-11a11f2d-4b5b-48cb-8d8a-acf6662de0e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:52.500533 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-11a11f2d-4b5b-48cb-8d8a-acf6662de0e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:52.501583 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-11a11f2d-4b5b-48cb-8d8a-acf6662de0e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:52.659755 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-11a11f2d-4b5b-48cb-8d8a-acf6662de0e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:52.669567 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-11a11f2d-4b5b-48cb-8d8a-acf6662de0e1 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1722 microversion: 2.1 time: 0.192364 Aug 04 10:29:52.670388 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 316/669] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:52 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:29:53.492830 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cd128fe4-def3-429b-bf89-38570c2693cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:53.493516 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-cd128fe4-def3-429b-bf89-38570c2693cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:53.500221 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cd128fe4-def3-429b-bf89-38570c2693cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:53.500683 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cd128fe4-def3-429b-bf89-38570c2693cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:53.501557 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cd128fe4-def3-429b-bf89-38570c2693cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:53.502103 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cd128fe4-def3-429b-bf89-38570c2693cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:53.564902 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-cd128fe4-def3-429b-bf89-38570c2693cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:53.573416 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-cd128fe4-def3-429b-bf89-38570c2693cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:53.574917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-cd128fe4-def3-429b-bf89-38570c2693cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:53.576040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-cd128fe4-def3-429b-bf89-38570c2693cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1352 microversion: 2.20 time: 0.088096 Aug 04 10:29:53.576602 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 354/670] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:29:53 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:29:53.691075 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-3ca0b354-2bc2-4a87-95b5-c07d0f0c3aa5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:53.691666 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-3ca0b354-2bc2-4a87-95b5-c07d0f0c3aa5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:53.698243 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3ca0b354-2bc2-4a87-95b5-c07d0f0c3aa5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:53.698685 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3ca0b354-2bc2-4a87-95b5-c07d0f0c3aa5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:53.699434 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3ca0b354-2bc2-4a87-95b5-c07d0f0c3aa5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:53.699861 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3ca0b354-2bc2-4a87-95b5-c07d0f0c3aa5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:53.828779 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-3ca0b354-2bc2-4a87-95b5-c07d0f0c3aa5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:53.837300 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-3ca0b354-2bc2-4a87-95b5-c07d0f0c3aa5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1722 microversion: 2.1 time: 0.150036 Aug 04 10:29:53.837864 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 317/671] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:53 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:54.598374 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6fa3dc4b-65dd-45cf-9d19-062c92febb7d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:54.598981 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6fa3dc4b-65dd-45cf-9d19-062c92febb7d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:54.605666 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6fa3dc4b-65dd-45cf-9d19-062c92febb7d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:54.606128 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6fa3dc4b-65dd-45cf-9d19-062c92febb7d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:54.606890 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6fa3dc4b-65dd-45cf-9d19-062c92febb7d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:54.607322 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6fa3dc4b-65dd-45cf-9d19-062c92febb7d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:54.669638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6fa3dc4b-65dd-45cf-9d19-062c92febb7d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:54.678529 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6fa3dc4b-65dd-45cf-9d19-062c92febb7d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:54.680069 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6fa3dc4b-65dd-45cf-9d19-062c92febb7d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:54.681171 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6fa3dc4b-65dd-45cf-9d19-062c92febb7d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1340 microversion: 2.20 time: 0.086655 Aug 04 10:29:54.681724 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 355/672] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:29:54 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1340 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:29:54.858636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-07267903-bd64-4f12-a842-0134dcc87d85 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:54.859149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-07267903-bd64-4f12-a842-0134dcc87d85 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:54.865753 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-07267903-bd64-4f12-a842-0134dcc87d85 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:54.866207 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-07267903-bd64-4f12-a842-0134dcc87d85 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:54.866977 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-07267903-bd64-4f12-a842-0134dcc87d85 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:54.867410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-07267903-bd64-4f12-a842-0134dcc87d85 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:55.002417 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-07267903-bd64-4f12-a842-0134dcc87d85 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:55.011099 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-07267903-bd64-4f12-a842-0134dcc87d85 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1722 microversion: 2.1 time: 0.156415 Aug 04 10:29:55.011677 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 318/673] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:54 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:55.703912 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-99586fa9-1128-4db9-a0dd-fedfe0b90506 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:55.704492 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-99586fa9-1128-4db9-a0dd-fedfe0b90506 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:55.711456 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-99586fa9-1128-4db9-a0dd-fedfe0b90506 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:55.712131 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-99586fa9-1128-4db9-a0dd-fedfe0b90506 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:55.713081 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-99586fa9-1128-4db9-a0dd-fedfe0b90506 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:55.713664 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-99586fa9-1128-4db9-a0dd-fedfe0b90506 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:55.846934 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-99586fa9-1128-4db9-a0dd-fedfe0b90506 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:55.855283 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-99586fa9-1128-4db9-a0dd-fedfe0b90506 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:55.856827 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-99586fa9-1128-4db9-a0dd-fedfe0b90506 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:55.857927 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-99586fa9-1128-4db9-a0dd-fedfe0b90506 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1408 microversion: 2.20 time: 0.158083 Aug 04 10:29:55.858487 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 356/674] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:29:55 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:29:56.034739 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f08806da-3714-44c7-9aab-d1797d1a7497 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:56.035429 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f08806da-3714-44c7-9aab-d1797d1a7497 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:56.043104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f08806da-3714-44c7-9aab-d1797d1a7497 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:56.043820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f08806da-3714-44c7-9aab-d1797d1a7497 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:56.044684 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f08806da-3714-44c7-9aab-d1797d1a7497 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:56.045144 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f08806da-3714-44c7-9aab-d1797d1a7497 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:56.182574 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f08806da-3714-44c7-9aab-d1797d1a7497 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:56.190775 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f08806da-3714-44c7-9aab-d1797d1a7497 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1728 microversion: 2.1 time: 0.159889 Aug 04 10:29:56.191342 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 319/675] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:29:56 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:29:56.228153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8d4b11dc-eab1-419d-b031-0dfcc1a23097 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:56.229002 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8d4b11dc-eab1-419d-b031-0dfcc1a23097 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:56.239908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8d4b11dc-eab1-419d-b031-0dfcc1a23097 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:56.240361 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8d4b11dc-eab1-419d-b031-0dfcc1a23097 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:56.241144 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8d4b11dc-eab1-419d-b031-0dfcc1a23097 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:56.241764 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8d4b11dc-eab1-419d-b031-0dfcc1a23097 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:56.297093 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-ac81f0f6-6ab7-4d71-aac8-458681945516 req-4e6fe60f-b840-4ddc-bba8-2b5fb192e519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d953ca9-81b0-46f6-af0f-22e198ddb24b", "tag": "e506b457-5f08-48b5-9d0b-c71bdf4640ec"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:56.312254 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-ac81f0f6-6ab7-4d71-aac8-458681945516 req-4e6fe60f-b840-4ddc-bba8-2b5fb192e519 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:56.312693 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-ac81f0f6-6ab7-4d71-aac8-458681945516 req-4e6fe60f-b840-4ddc-bba8-2b5fb192e519 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:56.326691 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-ac81f0f6-6ab7-4d71-aac8-458681945516 req-4e6fe60f-b840-4ddc-bba8-2b5fb192e519 service nova] Creating event network-changed:e506b457-5f08-48b5-9d0b-c71bdf4640ec for instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b on hv-cinder-82660 Aug 04 10:29:56.334081 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-ac81f0f6-6ab7-4d71-aac8-458681945516 req-4e6fe60f-b840-4ddc-bba8-2b5fb192e519 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040771 Aug 04 10:29:56.335319 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 320/676] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:29:56.347690 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8d4b11dc-eab1-419d-b031-0dfcc1a23097 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126979 Aug 04 10:29:56.355676 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 357/677] 10.222.0.72 () {58 vars in 1275 bytes} [Thu Aug 4 10:29:56 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:29:56.881939 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-fe4f0988-46d8-4a04-9578-beb7017f8f18 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:56.881939 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-fe4f0988-46d8-4a04-9578-beb7017f8f18 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:56.888956 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fe4f0988-46d8-4a04-9578-beb7017f8f18 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:56.889500 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fe4f0988-46d8-4a04-9578-beb7017f8f18 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:56.890279 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fe4f0988-46d8-4a04-9578-beb7017f8f18 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:56.890717 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fe4f0988-46d8-4a04-9578-beb7017f8f18 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:57.108596 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-fe4f0988-46d8-4a04-9578-beb7017f8f18 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:57.117186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-fe4f0988-46d8-4a04-9578-beb7017f8f18 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:57.118690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-fe4f0988-46d8-4a04-9578-beb7017f8f18 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:57.119797 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-fe4f0988-46d8-4a04-9578-beb7017f8f18 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1408 microversion: 2.20 time: 0.243735 Aug 04 10:29:57.120708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 321/678] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:29:56 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:29:57.332392 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-857601c6-6420-4540-b1a5-e27fb18d148a req-aff80ebf-4c83-4a3f-b928-ab924ad3dbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2293ba-55aa-43f6-a08d-06a3995d3fda", "tag": "639fe804-03ce-41d5-8378-a5c1423f8ab2"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:57.345845 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-857601c6-6420-4540-b1a5-e27fb18d148a req-aff80ebf-4c83-4a3f-b928-ab924ad3dbc7 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:57.346662 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-857601c6-6420-4540-b1a5-e27fb18d148a req-aff80ebf-4c83-4a3f-b928-ab924ad3dbc7 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:57.365241 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-857601c6-6420-4540-b1a5-e27fb18d148a req-aff80ebf-4c83-4a3f-b928-ab924ad3dbc7 service nova] Creating event network-changed:639fe804-03ce-41d5-8378-a5c1423f8ab2 for instance fd2293ba-55aa-43f6-a08d-06a3995d3fda on hv-cinder-82660 Aug 04 10:29:57.370803 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-857601c6-6420-4540-b1a5-e27fb18d148a req-aff80ebf-4c83-4a3f-b928-ab924ad3dbc7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045217 Aug 04 10:29:57.371513 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 358/679] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:29:58.143945 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d2ab0af1-c42c-4a9e-bf7e-176d9f9afacf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:58.146379 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-d2ab0af1-c42c-4a9e-bf7e-176d9f9afacf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:58.153699 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d2ab0af1-c42c-4a9e-bf7e-176d9f9afacf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:58.154438 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d2ab0af1-c42c-4a9e-bf7e-176d9f9afacf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:58.155372 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d2ab0af1-c42c-4a9e-bf7e-176d9f9afacf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:58.155806 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d2ab0af1-c42c-4a9e-bf7e-176d9f9afacf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:58.160301 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:58.318582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d2ab0af1-c42c-4a9e-bf7e-176d9f9afacf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:58.326494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d2ab0af1-c42c-4a9e-bf7e-176d9f9afacf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:58.328005 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d2ab0af1-c42c-4a9e-bf7e-176d9f9afacf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:58.329107 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d2ab0af1-c42c-4a9e-bf7e-176d9f9afacf tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1408 microversion: 2.20 time: 0.190261 Aug 04 10:29:58.329685 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 322/680] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:29:58 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:29:59.351940 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-77fc175e-4f05-49a4-b2e9-c5d716a508da tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:29:59.352681 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-77fc175e-4f05-49a4-b2e9-c5d716a508da tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:29:59.359002 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-77fc175e-4f05-49a4-b2e9-c5d716a508da tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:59.359454 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-77fc175e-4f05-49a4-b2e9-c5d716a508da tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:59.360271 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-77fc175e-4f05-49a4-b2e9-c5d716a508da tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:59.360707 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-77fc175e-4f05-49a4-b2e9-c5d716a508da tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:59.393824 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-ec6a3d5f-4e05-4355-9eca-ba04d72c68c9 req-17c7afb3-5515-4506-b8f3-11af60fc65b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2293ba-55aa-43f6-a08d-06a3995d3fda", "tag": "639fe804-03ce-41d5-8378-a5c1423f8ab2"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:29:59.411467 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-ec6a3d5f-4e05-4355-9eca-ba04d72c68c9 req-17c7afb3-5515-4506-b8f3-11af60fc65b3 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:29:59.412021 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-ec6a3d5f-4e05-4355-9eca-ba04d72c68c9 req-17c7afb3-5515-4506-b8f3-11af60fc65b3 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:29:59.423328 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-ec6a3d5f-4e05-4355-9eca-ba04d72c68c9 req-17c7afb3-5515-4506-b8f3-11af60fc65b3 service nova] Creating event network-changed:639fe804-03ce-41d5-8378-a5c1423f8ab2 for instance fd2293ba-55aa-43f6-a08d-06a3995d3fda on hv-cinder-82660 Aug 04 10:29:59.429246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-ec6a3d5f-4e05-4355-9eca-ba04d72c68c9 req-17c7afb3-5515-4506-b8f3-11af60fc65b3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041220 Aug 04 10:29:59.430511 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 323/681] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:29:59.532241 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-77fc175e-4f05-49a4-b2e9-c5d716a508da tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:59.540533 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-77fc175e-4f05-49a4-b2e9-c5d716a508da tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:59.542047 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-77fc175e-4f05-49a4-b2e9-c5d716a508da tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:29:59.543182 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-77fc175e-4f05-49a4-b2e9-c5d716a508da tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1408 microversion: 2.20 time: 0.196239 Aug 04 10:29:59.560053 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 359/682] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:29:59 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:30:00.567633 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ead7a900-55fa-415c-a757-aae47f763047 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:00.568350 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ead7a900-55fa-415c-a757-aae47f763047 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:00.574593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ead7a900-55fa-415c-a757-aae47f763047 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:00.575037 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ead7a900-55fa-415c-a757-aae47f763047 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:00.575789 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ead7a900-55fa-415c-a757-aae47f763047 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:00.576255 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ead7a900-55fa-415c-a757-aae47f763047 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:00.705675 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-ead7a900-55fa-415c-a757-aae47f763047 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:00.714249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-ead7a900-55fa-415c-a757-aae47f763047 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:00.715788 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-ead7a900-55fa-415c-a757-aae47f763047 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:00.716920 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ead7a900-55fa-415c-a757-aae47f763047 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1408 microversion: 2.20 time: 0.154622 Aug 04 10:30:00.717489 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 324/683] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:30:00 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:30:01.586841 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-3651cbaa-8c55-4f76-a63c-3aa961ab3fa2 req-dedc9ca4-a338-40c3-abb9-faaaab8c1a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d953ca9-81b0-46f6-af0f-22e198ddb24b", "name": "network-vif-plugged", "status": "completed", "tag": "e506b457-5f08-48b5-9d0b-c71bdf4640ec"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:01.597621 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-3651cbaa-8c55-4f76-a63c-3aa961ab3fa2 req-dedc9ca4-a338-40c3-abb9-faaaab8c1a7f service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:01.598073 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-3651cbaa-8c55-4f76-a63c-3aa961ab3fa2 req-dedc9ca4-a338-40c3-abb9-faaaab8c1a7f service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:01.609715 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-3651cbaa-8c55-4f76-a63c-3aa961ab3fa2 req-dedc9ca4-a338-40c3-abb9-faaaab8c1a7f service nova] Creating event network-vif-plugged:e506b457-5f08-48b5-9d0b-c71bdf4640ec for instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b on hv-cinder-82660 Aug 04 10:30:01.615144 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-3651cbaa-8c55-4f76-a63c-3aa961ab3fa2 req-dedc9ca4-a338-40c3-abb9-faaaab8c1a7f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032481 Aug 04 10:30:01.616078 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 360/684] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:01.738998 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-30c74da0-2d5c-4e09-8aae-8dda71c042c4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:01.739624 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-30c74da0-2d5c-4e09-8aae-8dda71c042c4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:01.747035 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-30c74da0-2d5c-4e09-8aae-8dda71c042c4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:01.747486 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-30c74da0-2d5c-4e09-8aae-8dda71c042c4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:01.748269 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-30c74da0-2d5c-4e09-8aae-8dda71c042c4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:01.748702 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-30c74da0-2d5c-4e09-8aae-8dda71c042c4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:01.918852 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-348da5fb-0855-4137-97f9-b71159b00315 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:01.921085 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-348da5fb-0855-4137-97f9-b71159b00315 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:01.927577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-348da5fb-0855-4137-97f9-b71159b00315 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:01.928043 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-348da5fb-0855-4137-97f9-b71159b00315 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:01.928888 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-348da5fb-0855-4137-97f9-b71159b00315 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:01.929320 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-348da5fb-0855-4137-97f9-b71159b00315 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:01.959493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-348da5fb-0855-4137-97f9-b71159b00315 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044888 Aug 04 10:30:01.960078 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 361/685] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:30:01 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 10:30:02.026198 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8a35718e-de0f-41d5-a875-42c5f0de5354 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:02.026695 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8a35718e-de0f-41d5-a875-42c5f0de5354 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:02.032752 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a35718e-de0f-41d5-a875-42c5f0de5354 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:02.033202 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a35718e-de0f-41d5-a875-42c5f0de5354 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:02.033970 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a35718e-de0f-41d5-a875-42c5f0de5354 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:02.034407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a35718e-de0f-41d5-a875-42c5f0de5354 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:02.050631 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-30c74da0-2d5c-4e09-8aae-8dda71c042c4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:02.059592 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-30c74da0-2d5c-4e09-8aae-8dda71c042c4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:02.061127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-30c74da0-2d5c-4e09-8aae-8dda71c042c4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:02.062256 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-30c74da0-2d5c-4e09-8aae-8dda71c042c4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1408 microversion: 2.20 time: 0.327477 Aug 04 10:30:02.062828 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 325/686] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:30:01 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1408 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:30:02.068096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8a35718e-de0f-41d5-a875-42c5f0de5354 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:30:02.070204 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:02.149008 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8a35718e-de0f-41d5-a875-42c5f0de5354 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 204 len: 0 microversion: 2.1 time: 0.126714 Aug 04 10:30:02.149677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 362/687] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:30:02 2022] DELETE /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 10:30:02.157863 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-46c6a4db-2ce7-4926-8864-643ccf69c377 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:02.158473 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-46c6a4db-2ce7-4926-8864-643ccf69c377 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:02.165055 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-46c6a4db-2ce7-4926-8864-643ccf69c377 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:02.165503 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-46c6a4db-2ce7-4926-8864-643ccf69c377 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:02.166266 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-46c6a4db-2ce7-4926-8864-643ccf69c377 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:02.166707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-46c6a4db-2ce7-4926-8864-643ccf69c377 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:02.297688 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-46c6a4db-2ce7-4926-8864-643ccf69c377 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:02.304385 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:02.306921 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-46c6a4db-2ce7-4926-8864-643ccf69c377 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1672 microversion: 2.1 time: 0.152890 Aug 04 10:30:02.307486 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 326/688] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:02 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:03.086069 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-74bf27f8-4652-4209-8c6e-b59de7687ee0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:03.087350 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-74bf27f8-4652-4209-8c6e-b59de7687ee0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:03.091126 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:03.095935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-74bf27f8-4652-4209-8c6e-b59de7687ee0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:03.096412 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-74bf27f8-4652-4209-8c6e-b59de7687ee0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:03.097177 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-74bf27f8-4652-4209-8c6e-b59de7687ee0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:03.097654 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-74bf27f8-4652-4209-8c6e-b59de7687ee0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:03.277157 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-74bf27f8-4652-4209-8c6e-b59de7687ee0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:03.284963 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-74bf27f8-4652-4209-8c6e-b59de7687ee0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:03.287083 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-74bf27f8-4652-4209-8c6e-b59de7687ee0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:03.288207 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-74bf27f8-4652-4209-8c6e-b59de7687ee0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1408 microversion: 2.20 time: 0.207193 Aug 04 10:30:03.288762 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 363/689] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:30:03 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:30:03.328590 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-bd2f7076-5fb0-44e8-be2e-628b54f807a7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:03.329206 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-bd2f7076-5fb0-44e8-be2e-628b54f807a7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:03.331017 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=10 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:03.337885 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd2f7076-5fb0-44e8-be2e-628b54f807a7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:03.338334 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd2f7076-5fb0-44e8-be2e-628b54f807a7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:03.339100 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd2f7076-5fb0-44e8-be2e-628b54f807a7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:03.339536 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd2f7076-5fb0-44e8-be2e-628b54f807a7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:03.467085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bd2f7076-5fb0-44e8-be2e-628b54f807a7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:03.475278 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-bd2f7076-5fb0-44e8-be2e-628b54f807a7 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1672 microversion: 2.1 time: 0.151096 Aug 04 10:30:03.475845 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 327/690] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:03 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:04.310882 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ab39a344-31e4-4a49-94de-44d6bc191cae tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:04.311490 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ab39a344-31e4-4a49-94de-44d6bc191cae tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:04.317516 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab39a344-31e4-4a49-94de-44d6bc191cae tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:04.317960 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab39a344-31e4-4a49-94de-44d6bc191cae tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:04.318826 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab39a344-31e4-4a49-94de-44d6bc191cae tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:04.319255 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab39a344-31e4-4a49-94de-44d6bc191cae tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:04.449126 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ab39a344-31e4-4a49-94de-44d6bc191cae tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:04.456998 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ab39a344-31e4-4a49-94de-44d6bc191cae tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:04.458542 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ab39a344-31e4-4a49-94de-44d6bc191cae tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:04.459689 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ab39a344-31e4-4a49-94de-44d6bc191cae tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1408 microversion: 2.20 time: 0.152872 Aug 04 10:30:04.460286 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 364/691] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:30:04 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:30:04.496120 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-3642f760-4935-402f-9e5f-675d29cabb9c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:04.496727 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-3642f760-4935-402f-9e5f-675d29cabb9c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:04.503196 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3642f760-4935-402f-9e5f-675d29cabb9c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:04.503593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3642f760-4935-402f-9e5f-675d29cabb9c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:04.504376 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3642f760-4935-402f-9e5f-675d29cabb9c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:04.504807 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3642f760-4935-402f-9e5f-675d29cabb9c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:04.630883 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-3642f760-4935-402f-9e5f-675d29cabb9c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:04.638416 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-3642f760-4935-402f-9e5f-675d29cabb9c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1672 microversion: 2.1 time: 0.146231 Aug 04 10:30:04.638982 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 328/692] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:04 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:05.482367 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4136fd58-10da-41a9-89e8-65f2c386dfd4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:05.482954 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4136fd58-10da-41a9-89e8-65f2c386dfd4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:05.490143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4136fd58-10da-41a9-89e8-65f2c386dfd4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:05.495630 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4136fd58-10da-41a9-89e8-65f2c386dfd4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:05.495630 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4136fd58-10da-41a9-89e8-65f2c386dfd4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:05.504401 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4136fd58-10da-41a9-89e8-65f2c386dfd4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:05.659568 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-bd4debe4-79b1-4eeb-854d-d8857956e64c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:05.660243 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-bd4debe4-79b1-4eeb-854d-d8857956e64c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:05.662853 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:05.669584 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd4debe4-79b1-4eeb-854d-d8857956e64c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:05.670131 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd4debe4-79b1-4eeb-854d-d8857956e64c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:05.670989 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd4debe4-79b1-4eeb-854d-d8857956e64c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:05.671437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd4debe4-79b1-4eeb-854d-d8857956e64c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:06.031596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4136fd58-10da-41a9-89e8-65f2c386dfd4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:06.040516 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4136fd58-10da-41a9-89e8-65f2c386dfd4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:06.042160 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4136fd58-10da-41a9-89e8-65f2c386dfd4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:06.043568 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4136fd58-10da-41a9-89e8-65f2c386dfd4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1600 microversion: 2.20 time: 0.565176 Aug 04 10:30:06.044167 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 365/693] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:30:05 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1600 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:30:06.062284 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bd4debe4-79b1-4eeb-854d-d8857956e64c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:06.066104 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d769c917-f4fe-4217-80ee-371476c9de0b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:06.066915 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d769c917-f4fe-4217-80ee-371476c9de0b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:06.071203 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-bd4debe4-79b1-4eeb-854d-d8857956e64c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 200 len: 1672 microversion: 2.1 time: 0.415421 Aug 04 10:30:06.071987 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 329/694] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:05 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 1672 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:30:06.072705 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d769c917-f4fe-4217-80ee-371476c9de0b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:06.073154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d769c917-f4fe-4217-80ee-371476c9de0b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:06.073915 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d769c917-f4fe-4217-80ee-371476c9de0b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:06.074339 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d769c917-f4fe-4217-80ee-371476c9de0b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:06.168214 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d769c917-f4fe-4217-80ee-371476c9de0b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105723 Aug 04 10:30:06.168987 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 366/695] 10.222.0.72 () {60 vars in 1316 bytes} [Thu Aug 4 10:30:06 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:30:06.483081 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-54115b5d-9845-400c-bc6e-448ce8a89979 req-5e31dcb6-9fdd-461e-8ada-8e787206a728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf60275d-fda6-4f0c-8a2f-14f85d685623", "name": "network-vif-deleted", "tag": "a7f1ba8f-d703-43d1-94d9-5c0b11630a04"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:06.492987 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-54115b5d-9845-400c-bc6e-448ce8a89979 req-5e31dcb6-9fdd-461e-8ada-8e787206a728 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:06.493419 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-54115b5d-9845-400c-bc6e-448ce8a89979 req-5e31dcb6-9fdd-461e-8ada-8e787206a728 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:06.505923 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-54115b5d-9845-400c-bc6e-448ce8a89979 req-5e31dcb6-9fdd-461e-8ada-8e787206a728 service nova] Creating event network-vif-deleted:a7f1ba8f-d703-43d1-94d9-5c0b11630a04 for instance cf60275d-fda6-4f0c-8a2f-14f85d685623 on hv-cinder-82660 Aug 04 10:30:06.510773 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-54115b5d-9845-400c-bc6e-448ce8a89979 req-5e31dcb6-9fdd-461e-8ada-8e787206a728 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031571 Aug 04 10:30:06.511915 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 330/696] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:07.102149 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1425914d-7e45-49c5-b20e-7d27ed9a3360 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:07.103280 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1425914d-7e45-49c5-b20e-7d27ed9a3360 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:07.111097 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1425914d-7e45-49c5-b20e-7d27ed9a3360 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:07.111924 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1425914d-7e45-49c5-b20e-7d27ed9a3360 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:07.112936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1425914d-7e45-49c5-b20e-7d27ed9a3360 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:07.113598 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1425914d-7e45-49c5-b20e-7d27ed9a3360 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:07.131721 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-1425914d-7e45-49c5-b20e-7d27ed9a3360 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] HTTP exception thrown: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1425914d-7e45-49c5-b20e-7d27ed9a3360 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Request method failure captured: Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 HTTP/1.1 Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656LIUmaJXn-WJ6_eQYITzPtjT6AqDPxBPS6Eo190Dc6E1IcObF-fA7Psf8oyPmurxgByqUueSdJ5XSRXtI_rFWE0v-kIoiC7Im0XIr_c3V5yiKb8WkJWFLog_g5KiJJw1PPBpWZAoJ_6kiqLVWkcgLt-ufZ2rRKsWIzixsZwsyANRw Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 888ab157217942abaf98b99e8eb827de Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:30:07.134154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:30:07.135740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/888ab157217942abaf98b99e8eb827de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/888ab157217942abaf98b99e8eb827de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/888ab157217942abaf98b99e8eb827de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_888ab157217942abaf98b99e8eb827de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:30:07.135740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:30:07.135740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 888ab157217942abaf98b99e8eb827de Aug 04 10:30:07.135740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:30:07.135740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeTestJSON-4512277-project Aug 04 10:30:07.135740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:30:07.135740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:30:07.135740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: 0ac9aa3a8d7a4383b9211cbac185a325 Aug 04 10:30:07.135740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeTestJSON-4512277-project Aug 04 10:30:07.135740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:30:07.135740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:30:07.135740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': 'cf60275d-fda6-4f0c-8a2f-14f85d685623'} Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:30:07.136745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:30:07.138228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:07.140590 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1425914d-7e45-49c5-b20e-7d27ed9a3360 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Returning 404 to user: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:30:07.141709 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1425914d-7e45-49c5-b20e-7d27ed9a3360 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 404 len: 111 microversion: 2.1 time: 0.051706 Aug 04 10:30:07.146735 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 367/697] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:07 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:30:07.153991 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-54a526bf-b013-463e-bfb7-696cbcd5593e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '.version_select at 0x7fbaa47381f0>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:07.183660 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-54a526bf-b013-463e-bfb7-696cbcd5593e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-952418968" status: 202 len: 0 microversion: 2.1 time: 0.035537 Aug 04 10:30:07.184492 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 331/698] 10.222.0.72 () {58 vars in 1218 bytes} [Thu Aug 4 10:30:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-952418968 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:30:07.576256 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-e1a0ab2e-6902-471c-a19f-25dfed162746 req-6526b853-4156-4bbd-a817-6e9b846be875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d953ca9-81b0-46f6-af0f-22e198ddb24b", "tag": "e506b457-5f08-48b5-9d0b-c71bdf4640ec"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:07.596325 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-e1a0ab2e-6902-471c-a19f-25dfed162746 req-6526b853-4156-4bbd-a817-6e9b846be875 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:07.597124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-e1a0ab2e-6902-471c-a19f-25dfed162746 req-6526b853-4156-4bbd-a817-6e9b846be875 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:07.609437 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-e1a0ab2e-6902-471c-a19f-25dfed162746 req-6526b853-4156-4bbd-a817-6e9b846be875 service nova] Creating event network-changed:e506b457-5f08-48b5-9d0b-c71bdf4640ec for instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b on hv-cinder-82660 Aug 04 10:30:07.615627 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-e1a0ab2e-6902-471c-a19f-25dfed162746 req-6526b853-4156-4bbd-a817-6e9b846be875 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043382 Aug 04 10:30:07.616373 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 368/699] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:07.974604 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-88693a6c-390c-4da2-affb-2ad3596c7197 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Action: 'create', calling method: .version_select at 0x7fbaa98d79d0>, body: {"keypair": {"name": "tempest-keypair-1503271122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaIkbbycVtqHo3ueDGwYT8089vgQXXcad0jCioJjAucvuODOdhYHDoSEmWwlne/2LPA0tFksXtq9B4IJH4NptVQ3YM/qBL4XqJxV/RilM8c/TK7j1Pq2Z17M6Zr1IX93Q=="}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:07.992045 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-88693a6c-390c-4da2-affb-2ad3596c7197 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Getting quotas for project 888ab157217942abaf98b99e8eb827de. Resources: {'key_pairs'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:30:07.996307 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-88693a6c-390c-4da2-affb-2ad3596c7197 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Getting quotas for user 0ac9aa3a8d7a4383b9211cbac185a325 and project 888ab157217942abaf98b99e8eb827de. Resources: {'key_pairs'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:30:08.020914 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-88693a6c-390c-4da2-affb-2ad3596c7197 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051090 Aug 04 10:30:08.027556 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 332/700] 10.222.0.72 () {60 vars in 1159 bytes} [Thu Aug 4 10:30:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:09.353107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-726933348", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1871b80-9570-42a3-943d-f71bd233c50d"}], "security_groups": [{"name": "tempest-securitygroup--1396982224"}], "key_name": "tempest-keypair-1503271122", "user_data": "}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:09.457837 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] validate_networks() for [('a1871b80-9570-42a3-943d-f71bd233c50d', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:30:09.820063 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:30:09.820610 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:30:09.821090 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:30:09.821497 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:30:09.821906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:30:09.831656 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:09.832157 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:09.833466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:09.833880 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:09.850871 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Getting quotas for project 888ab157217942abaf98b99e8eb827de. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:30:09.854817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Getting quotas for user 0ac9aa3a8d7a4383b9211cbac185a325 and project 888ab157217942abaf98b99e8eb827de. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:30:09.865497 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:30:09.867820 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:30:09.912380 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-20ecdbbc-5986-43c5-9e0b-5494e393bd7c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.563774 Aug 04 10:30:09.913021 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 369/701] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:30:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:30:09.924200 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-011e9fe8-b06b-4022-89ed-fa332f18d6db tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:09.925038 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-011e9fe8-b06b-4022-89ed-fa332f18d6db tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:09.979128 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-011e9fe8-b06b-4022-89ed-fa332f18d6db tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:09.985822 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-011e9fe8-b06b-4022-89ed-fa332f18d6db tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 200 len: 1237 microversion: 2.1 time: 0.065991 Aug 04 10:30:09.986470 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 333/702] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:09 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:11.008712 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2e4af8c8-711a-4564-aa47-9571c5a2f764 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:11.009419 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2e4af8c8-711a-4564-aa47-9571c5a2f764 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:11.018442 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e4af8c8-711a-4564-aa47-9571c5a2f764 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:11.019202 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e4af8c8-711a-4564-aa47-9571c5a2f764 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:11.020138 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e4af8c8-711a-4564-aa47-9571c5a2f764 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:11.021428 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2e4af8c8-711a-4564-aa47-9571c5a2f764 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:11.092981 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2e4af8c8-711a-4564-aa47-9571c5a2f764 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:11.100947 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2e4af8c8-711a-4564-aa47-9571c5a2f764 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 200 len: 1295 microversion: 2.1 time: 0.098011 Aug 04 10:30:11.101506 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 370/703] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:11 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 1295 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:12.122325 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e111bdd1-23ac-41cb-a463-b345a0a8f391 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:12.123021 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e111bdd1-23ac-41cb-a463-b345a0a8f391 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:12.130033 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e111bdd1-23ac-41cb-a463-b345a0a8f391 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:12.130557 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e111bdd1-23ac-41cb-a463-b345a0a8f391 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:12.131508 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e111bdd1-23ac-41cb-a463-b345a0a8f391 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:12.132073 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e111bdd1-23ac-41cb-a463-b345a0a8f391 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:12.340894 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e111bdd1-23ac-41cb-a463-b345a0a8f391 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:12.349310 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e111bdd1-23ac-41cb-a463-b345a0a8f391 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 200 len: 1363 microversion: 2.1 time: 0.230875 Aug 04 10:30:12.349932 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 334/704] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:12 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:12.746893 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-acc4d0bc-ddd1-4af9-9c19-4cd2ea8783d6 req-d428d246-05af-4d8d-a3a2-8e31f8f48c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f07bbd9-4e21-48ad-8ab9-fe9af12060be", "tag": "21c372bf-56d3-49ad-8df8-029534399855"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:12.760474 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-acc4d0bc-ddd1-4af9-9c19-4cd2ea8783d6 req-d428d246-05af-4d8d-a3a2-8e31f8f48c6f service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:12.760914 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-acc4d0bc-ddd1-4af9-9c19-4cd2ea8783d6 req-d428d246-05af-4d8d-a3a2-8e31f8f48c6f service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:12.774217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-acc4d0bc-ddd1-4af9-9c19-4cd2ea8783d6 req-d428d246-05af-4d8d-a3a2-8e31f8f48c6f service nova] Creating event network-changed:21c372bf-56d3-49ad-8df8-029534399855 for instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be on hv-cinder-82660 Aug 04 10:30:12.779256 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-acc4d0bc-ddd1-4af9-9c19-4cd2ea8783d6 req-d428d246-05af-4d8d-a3a2-8e31f8f48c6f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036136 Aug 04 10:30:12.779840 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 371/705] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:13.217675 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7ca4c933-53ae-4432-86bc-7327b08124ba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:13.217675 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7ca4c933-53ae-4432-86bc-7327b08124ba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:13.224654 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7ca4c933-53ae-4432-86bc-7327b08124ba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:13.225103 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7ca4c933-53ae-4432-86bc-7327b08124ba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:13.225867 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7ca4c933-53ae-4432-86bc-7327b08124ba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:13.226301 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-7ca4c933-53ae-4432-86bc-7327b08124ba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:13.250181 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7ca4c933-53ae-4432-86bc-7327b08124ba tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/ips" status: 200 len: 150 microversion: 2.1 time: 0.037868 Aug 04 10:30:13.250764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 335/706] 10.222.0.72 () {58 vars in 1248 bytes} [Thu Aug 4 10:30:13 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:13.370686 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4ee10cae-edac-41a5-b06e-549abc9239a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:13.371383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4ee10cae-edac-41a5-b06e-549abc9239a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:13.377666 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4ee10cae-edac-41a5-b06e-549abc9239a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:13.378121 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4ee10cae-edac-41a5-b06e-549abc9239a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:13.378957 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4ee10cae-edac-41a5-b06e-549abc9239a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:13.379320 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4ee10cae-edac-41a5-b06e-549abc9239a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:13.519078 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4ee10cae-edac-41a5-b06e-549abc9239a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:13.526590 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4ee10cae-edac-41a5-b06e-549abc9239a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 200 len: 1363 microversion: 2.1 time: 0.160107 Aug 04 10:30:13.527363 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 372/707] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:13 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:14.547853 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6b8c5c48-1716-4fe3-98f0-0e56dfb8306a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:14.548495 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6b8c5c48-1716-4fe3-98f0-0e56dfb8306a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:14.555757 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6b8c5c48-1716-4fe3-98f0-0e56dfb8306a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:14.556240 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6b8c5c48-1716-4fe3-98f0-0e56dfb8306a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:14.557000 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6b8c5c48-1716-4fe3-98f0-0e56dfb8306a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:14.557430 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6b8c5c48-1716-4fe3-98f0-0e56dfb8306a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:14.595643 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ef00dfeb-147a-414d-8fb2-e5a54a35db19 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dae21b3-4e67-4e49-b448-80caa4c29417"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:14.598103 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ef00dfeb-147a-414d-8fb2-e5a54a35db19 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:14.604810 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef00dfeb-147a-414d-8fb2-e5a54a35db19 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:14.605265 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef00dfeb-147a-414d-8fb2-e5a54a35db19 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:14.606042 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef00dfeb-147a-414d-8fb2-e5a54a35db19 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:14.606479 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef00dfeb-147a-414d-8fb2-e5a54a35db19 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:14.776541 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6b8c5c48-1716-4fe3-98f0-0e56dfb8306a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:14.784949 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6b8c5c48-1716-4fe3-98f0-0e56dfb8306a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 200 len: 1363 microversion: 2.1 time: 0.240953 Aug 04 10:30:14.785884 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 336/708] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:14 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:14.860425 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ef00dfeb-147a-414d-8fb2-e5a54a35db19 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "POST /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268457 Aug 04 10:30:14.861143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 373/709] 10.222.0.72 () {60 vars in 1323 bytes} [Thu Aug 4 10:30:14 2022] POST /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:30:15.863523 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-20e28875-d992-4ac7-b234-7640e279324f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:15.864181 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-20e28875-d992-4ac7-b234-7640e279324f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:15.870220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-20e28875-d992-4ac7-b234-7640e279324f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:15.870659 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-20e28875-d992-4ac7-b234-7640e279324f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:15.872370 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-20e28875-d992-4ac7-b234-7640e279324f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:15.872813 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-20e28875-d992-4ac7-b234-7640e279324f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:16.018091 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-20e28875-d992-4ac7-b234-7640e279324f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:16.026168 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-20e28875-d992-4ac7-b234-7640e279324f tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 200 len: 1363 microversion: 2.1 time: 0.222567 Aug 04 10:30:16.026737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 337/710] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:15 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:16.584660 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1b61804f-588b-456a-ac41-984f66e6cf58 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:16.585376 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-1b61804f-588b-456a-ac41-984f66e6cf58 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:16.591576 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1b61804f-588b-456a-ac41-984f66e6cf58 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:16.592412 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1b61804f-588b-456a-ac41-984f66e6cf58 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:16.593163 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1b61804f-588b-456a-ac41-984f66e6cf58 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:16.593786 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-1b61804f-588b-456a-ac41-984f66e6cf58 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:16.618112 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-1b61804f-588b-456a-ac41-984f66e6cf58 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lazy-loading 'flavor' on Instance uuid 34e129c5-a1f4-418e-a7c7-8840c88c20e9 {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:30:16.691106 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1b61804f-588b-456a-ac41-984f66e6cf58 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "POST /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9/action" status: 202 len: 0 microversion: 2.1 time: 0.111068 Aug 04 10:30:16.691885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 374/711] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:30:16 2022] POST /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:30:16.701438 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-bd90a391-5164-41ef-af02-deea0fb6a9c7 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:16.702364 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-bd90a391-5164-41ef-af02-deea0fb6a9c7 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:16.709010 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd90a391-5164-41ef-af02-deea0fb6a9c7 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:16.709469 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd90a391-5164-41ef-af02-deea0fb6a9c7 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:16.710242 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd90a391-5164-41ef-af02-deea0fb6a9c7 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:16.710685 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd90a391-5164-41ef-af02-deea0fb6a9c7 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:16.845196 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bd90a391-5164-41ef-af02-deea0fb6a9c7 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:16.852799 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-bd90a391-5164-41ef-af02-deea0fb6a9c7 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1570 microversion: 2.1 time: 0.155407 Aug 04 10:30:16.853363 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 338/712] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:16 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:30:17.047091 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9e4b5861-1905-4169-b0ae-3d22bda4de72 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:17.048037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9e4b5861-1905-4169-b0ae-3d22bda4de72 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:17.055943 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e4b5861-1905-4169-b0ae-3d22bda4de72 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:17.056488 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e4b5861-1905-4169-b0ae-3d22bda4de72 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:17.057307 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e4b5861-1905-4169-b0ae-3d22bda4de72 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:17.057802 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e4b5861-1905-4169-b0ae-3d22bda4de72 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:17.196677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9e4b5861-1905-4169-b0ae-3d22bda4de72 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:17.203990 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9e4b5861-1905-4169-b0ae-3d22bda4de72 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 200 len: 1363 microversion: 2.1 time: 0.161089 Aug 04 10:30:17.204557 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 375/713] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:17 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:17.553099 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-e626190b-3859-494e-b4c4-f70187fc3966 req-b460ccfd-e3b6-467b-90c1-c346d7db131e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f07bbd9-4e21-48ad-8ab9-fe9af12060be", "name": "network-vif-plugged", "status": "completed", "tag": "21c372bf-56d3-49ad-8df8-029534399855"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:17.563916 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-e626190b-3859-494e-b4c4-f70187fc3966 req-b460ccfd-e3b6-467b-90c1-c346d7db131e service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:17.564872 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-e626190b-3859-494e-b4c4-f70187fc3966 req-b460ccfd-e3b6-467b-90c1-c346d7db131e service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:17.576348 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-e626190b-3859-494e-b4c4-f70187fc3966 req-b460ccfd-e3b6-467b-90c1-c346d7db131e service nova] Creating event network-vif-plugged:21c372bf-56d3-49ad-8df8-029534399855 for instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be on hv-cinder-82660 Aug 04 10:30:17.581455 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-e626190b-3859-494e-b4c4-f70187fc3966 req-b460ccfd-e3b6-467b-90c1-c346d7db131e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035103 Aug 04 10:30:17.582243 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 339/714] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:17.874809 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c71e68df-d998-4035-97e3-eb10b9541848 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:17.875422 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c71e68df-d998-4035-97e3-eb10b9541848 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:17.882800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c71e68df-d998-4035-97e3-eb10b9541848 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:17.883249 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c71e68df-d998-4035-97e3-eb10b9541848 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:17.884058 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c71e68df-d998-4035-97e3-eb10b9541848 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:17.884504 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c71e68df-d998-4035-97e3-eb10b9541848 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:18.014800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c71e68df-d998-4035-97e3-eb10b9541848 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:18.023022 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c71e68df-d998-4035-97e3-eb10b9541848 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1570 microversion: 2.1 time: 0.152282 Aug 04 10:30:18.023587 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 376/715] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:17 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:18.225530 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-babadced-2b89-4b83-97bd-8981cc6ef80a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:18.226224 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-babadced-2b89-4b83-97bd-8981cc6ef80a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:18.232995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-babadced-2b89-4b83-97bd-8981cc6ef80a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:18.233441 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-babadced-2b89-4b83-97bd-8981cc6ef80a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:18.234197 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-babadced-2b89-4b83-97bd-8981cc6ef80a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:18.234633 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-babadced-2b89-4b83-97bd-8981cc6ef80a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:18.369797 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-babadced-2b89-4b83-97bd-8981cc6ef80a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:18.377519 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-babadced-2b89-4b83-97bd-8981cc6ef80a tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 200 len: 1363 microversion: 2.1 time: 0.156128 Aug 04 10:30:18.378153 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 340/716] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:18 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:19.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ab3ae55e-2481-4f3d-9619-d103701082f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:19.048202 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ab3ae55e-2481-4f3d-9619-d103701082f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:19.050927 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:19.056656 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab3ae55e-2481-4f3d-9619-d103701082f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:19.057172 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab3ae55e-2481-4f3d-9619-d103701082f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:19.058128 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab3ae55e-2481-4f3d-9619-d103701082f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:19.058695 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ab3ae55e-2481-4f3d-9619-d103701082f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:19.077730 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:19.201347 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ab3ae55e-2481-4f3d-9619-d103701082f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:19.209507 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ab3ae55e-2481-4f3d-9619-d103701082f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1570 microversion: 2.1 time: 0.165986 Aug 04 10:30:19.210124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 377/717] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:19 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:19.400164 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a0ca0a2c-41ce-4034-ad3c-8d93e77d3d43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:19.400888 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a0ca0a2c-41ce-4034-ad3c-8d93e77d3d43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:19.407269 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a0ca0a2c-41ce-4034-ad3c-8d93e77d3d43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:19.407703 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a0ca0a2c-41ce-4034-ad3c-8d93e77d3d43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:19.408487 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a0ca0a2c-41ce-4034-ad3c-8d93e77d3d43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:19.408912 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a0ca0a2c-41ce-4034-ad3c-8d93e77d3d43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:19.540526 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a0ca0a2c-41ce-4034-ad3c-8d93e77d3d43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:19.547868 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a0ca0a2c-41ce-4034-ad3c-8d93e77d3d43 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 200 len: 1363 microversion: 2.1 time: 0.152466 Aug 04 10:30:19.548466 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 341/718] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:19 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:20.231508 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5f636378-4967-406d-87e6-7dd3eb168a4a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:20.232151 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5f636378-4967-406d-87e6-7dd3eb168a4a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:20.233986 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:20.234737 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:20.241798 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5f636378-4967-406d-87e6-7dd3eb168a4a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:20.242245 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5f636378-4967-406d-87e6-7dd3eb168a4a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:20.243019 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5f636378-4967-406d-87e6-7dd3eb168a4a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:20.243449 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5f636378-4967-406d-87e6-7dd3eb168a4a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:20.385494 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5f636378-4967-406d-87e6-7dd3eb168a4a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:20.392936 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5f636378-4967-406d-87e6-7dd3eb168a4a tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1570 microversion: 2.1 time: 0.165498 Aug 04 10:30:20.393486 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 378/719] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:20 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:20.569286 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e4a94276-6231-48a1-8828-32bea6f3b9a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:20.569923 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e4a94276-6231-48a1-8828-32bea6f3b9a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:20.571913 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=6 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:20.577743 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e4a94276-6231-48a1-8828-32bea6f3b9a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:20.578187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e4a94276-6231-48a1-8828-32bea6f3b9a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:20.578937 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e4a94276-6231-48a1-8828-32bea6f3b9a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:20.579368 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e4a94276-6231-48a1-8828-32bea6f3b9a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:20.713243 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e4a94276-6231-48a1-8828-32bea6f3b9a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:20.720650 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e4a94276-6231-48a1-8828-32bea6f3b9a5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 200 len: 1549 microversion: 2.1 time: 0.155289 Aug 04 10:30:20.721218 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 342/720] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:20 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:20.741417 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ce1785e1-718f-4279-8ab6-344fb620082d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:20.741906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ce1785e1-718f-4279-8ab6-344fb620082d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:20.747899 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce1785e1-718f-4279-8ab6-344fb620082d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:20.748376 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce1785e1-718f-4279-8ab6-344fb620082d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:20.749143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce1785e1-718f-4279-8ab6-344fb620082d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:20.749572 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce1785e1-718f-4279-8ab6-344fb620082d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:20.826949 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ce1785e1-718f-4279-8ab6-344fb620082d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089370 Aug 04 10:30:20.827539 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 379/721] 10.222.0.72 () {58 vars in 1275 bytes} [Thu Aug 4 10:30:20 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:21.415028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-389b9014-d6d7-41fc-8364-4d5aa2a7aeca tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:21.415661 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-389b9014-d6d7-41fc-8364-4d5aa2a7aeca tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:21.422000 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-389b9014-d6d7-41fc-8364-4d5aa2a7aeca tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:21.422445 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-389b9014-d6d7-41fc-8364-4d5aa2a7aeca tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:21.423212 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-389b9014-d6d7-41fc-8364-4d5aa2a7aeca tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:21.423638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-389b9014-d6d7-41fc-8364-4d5aa2a7aeca tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:21.644685 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-389b9014-d6d7-41fc-8364-4d5aa2a7aeca tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:21.652812 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-389b9014-d6d7-41fc-8364-4d5aa2a7aeca tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1570 microversion: 2.1 time: 0.242367 Aug 04 10:30:21.653373 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 343/722] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:21 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1570 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:21.841181 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-37ff91e2-2aec-4f72-991d-8cde46f9008a req-707ada2d-a65c-4c8e-8602-91646355f73e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f07bbd9-4e21-48ad-8ab9-fe9af12060be", "tag": "21c372bf-56d3-49ad-8df8-029534399855"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:21.850882 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-37ff91e2-2aec-4f72-991d-8cde46f9008a req-707ada2d-a65c-4c8e-8602-91646355f73e service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:21.851313 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-37ff91e2-2aec-4f72-991d-8cde46f9008a req-707ada2d-a65c-4c8e-8602-91646355f73e service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:21.862162 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-37ff91e2-2aec-4f72-991d-8cde46f9008a req-707ada2d-a65c-4c8e-8602-91646355f73e service nova] Creating event network-changed:21c372bf-56d3-49ad-8df8-029534399855 for instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be on hv-cinder-82660 Aug 04 10:30:21.868131 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-37ff91e2-2aec-4f72-991d-8cde46f9008a req-707ada2d-a65c-4c8e-8602-91646355f73e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030859 Aug 04 10:30:21.868757 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 380/723] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:22.421039 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-816eb362-e3b3-41db-abc8-a5fdb9c620df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dae21b3-4e67-4e49-b448-80caa4c29417"}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:22.423624 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-816eb362-e3b3-41db-abc8-a5fdb9c620df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:22.432518 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-816eb362-e3b3-41db-abc8-a5fdb9c620df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:22.432994 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-816eb362-e3b3-41db-abc8-a5fdb9c620df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:22.435270 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-816eb362-e3b3-41db-abc8-a5fdb9c620df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:22.435938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-816eb362-e3b3-41db-abc8-a5fdb9c620df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:22.441944 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=100 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:22.525701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-816eb362-e3b3-41db-abc8-a5fdb9c620df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] HTTP exception thrown: Invalid volume: volume 8dae21b3-4e67-4e49-b448-80caa4c29417 is already attached to instances: 228506d2-27e6-4bab-991d-0695ea9543c3 Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-816eb362-e3b3-41db-abc8-a5fdb9c620df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Request method failure captured: Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: POST /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/os-volume_attachments HTTP/1.1 Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 74 Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656Tob97WbD_ZS5F2g-QN7pC61pEa9bei56wET8TrZeizeYQWOy31gmFZi3BtMbEG-sSRMiaAjSOk7-SIrWX3R_-R1F1qjTprnkQ7VwtSLuza02D0xNMbtZfy2jBcBSsmOWIl7uTSBWVqK40vdniduqG7S6ibX_f6b3y_2MqFav-ZhA Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:30:22.527428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:30:22.528772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:30:22.528772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:30:22.528772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:30:22.528772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:30:22.528772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:30:22.528772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:30:22.528772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:30:22.528772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: b680411b142642b7acc3585d2481f880 Aug 04 10:30:22.528772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:30:22.528772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Aug 04 10:30:22.528772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {"volumeAttachment": {"volumeId": "8dae21b3-4e67-4e49-b448-80caa4c29417"}} Aug 04 10:30:22.528772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Invalid volume: volume 8dae21b3-4e67-4e49-b448-80caa4c29417 is already attached to instances: 228506d2-27e6-4bab-991d-0695ea9543c3 Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'server_id': '228506d2-27e6-4bab-991d-0695ea9543c3', 'body': {'volumeAttachment': {'volumeId': '8dae21b3-4e67-4e49-b448-80caa4c29417'}}} Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8dae21b3-4e67-4e49-b448-80caa4c29417 is already attached to instances: 228506d2-27e6-4bab-991d-0695ea9543c3 Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:30:22.529504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8dae21b3-4e67-4e49-b448-80caa4c29417 is already attached to instances: 228506d2-27e6-4bab-991d-0695ea9543c3 Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:22.530594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:30:22.531800 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:30:22.531800 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:30:22.531800 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:30:22.531800 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8dae21b3-4e67-4e49-b448-80caa4c29417 is already attached to instances: 228506d2-27e6-4bab-991d-0695ea9543c3 Aug 04 10:30:22.531800 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:30:22.531800 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-816eb362-e3b3-41db-abc8-a5fdb9c620df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Returning 400 to user: Invalid volume: volume 8dae21b3-4e67-4e49-b448-80caa4c29417 is already attached to instances: 228506d2-27e6-4bab-991d-0695ea9543c3 {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:30:22.531800 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-816eb362-e3b3-41db-abc8-a5fdb9c620df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "POST /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114472 Aug 04 10:30:22.531800 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 344/724] 10.222.0.72 () {60 vars in 1323 bytes} [Thu Aug 4 10:30:22 2022] POST /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:30:22.595922 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b90581eb-bd60-4700-9054-137711e5ae07 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:22.596528 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b90581eb-bd60-4700-9054-137711e5ae07 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:22.603412 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b90581eb-bd60-4700-9054-137711e5ae07 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:22.603862 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b90581eb-bd60-4700-9054-137711e5ae07 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:22.604659 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b90581eb-bd60-4700-9054-137711e5ae07 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:22.605095 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b90581eb-bd60-4700-9054-137711e5ae07 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:22.675028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-3bbd7ae1-f6ef-4801-a119-d35f48f2e1d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:22.676026 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-3bbd7ae1-f6ef-4801-a119-d35f48f2e1d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:22.683630 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3bbd7ae1-f6ef-4801-a119-d35f48f2e1d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:22.684105 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3bbd7ae1-f6ef-4801-a119-d35f48f2e1d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:22.684882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3bbd7ae1-f6ef-4801-a119-d35f48f2e1d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:22.685314 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3bbd7ae1-f6ef-4801-a119-d35f48f2e1d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:22.691325 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-b90581eb-bd60-4700-9054-137711e5ae07 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lazy-loading 'services' on Instance uuid 228506d2-27e6-4bab-991d-0695ea9543c3 {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:30:22.778625 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b90581eb-bd60-4700-9054-137711e5ae07 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/os-volume_attachments/8dae21b3-4e67-4e49-b448-80caa4c29417" status: 202 len: 0 microversion: 2.1 time: 0.186871 Aug 04 10:30:22.779451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 381/725] 10.222.0.72 () {58 vars in 1416 bytes} [Thu Aug 4 10:30:22 2022] DELETE /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/os-volume_attachments/8dae21b3-4e67-4e49-b448-80caa4c29417 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:30:22.788923 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bf6d352d-65b4-4ab3-b2c6-0d6d84ffc6b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:22.791553 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bf6d352d-65b4-4ab3-b2c6-0d6d84ffc6b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:22.798628 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf6d352d-65b4-4ab3-b2c6-0d6d84ffc6b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:22.799248 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf6d352d-65b4-4ab3-b2c6-0d6d84ffc6b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:22.801544 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf6d352d-65b4-4ab3-b2c6-0d6d84ffc6b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:22.801992 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf6d352d-65b4-4ab3-b2c6-0d6d84ffc6b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:22.836229 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-3bbd7ae1-f6ef-4801-a119-d35f48f2e1d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:22.840651 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bf6d352d-65b4-4ab3-b2c6-0d6d84ffc6b0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056614 Aug 04 10:30:22.844785 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-3bbd7ae1-f6ef-4801-a119-d35f48f2e1d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1570 microversion: 2.1 time: 0.175392 Aug 04 10:30:22.845808 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 382/726] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:30:22 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:30:22.856886 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 345/727] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:22 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:30:23.853309 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2f4dd820-ac3f-4a1e-a308-fbea731883a7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:23.855489 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2f4dd820-ac3f-4a1e-a308-fbea731883a7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:23.862039 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2f4dd820-ac3f-4a1e-a308-fbea731883a7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:23.862480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2f4dd820-ac3f-4a1e-a308-fbea731883a7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:23.863585 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2f4dd820-ac3f-4a1e-a308-fbea731883a7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:23.863773 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2f4dd820-ac3f-4a1e-a308-fbea731883a7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:23.868468 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-17013681-605e-44e6-9977-9aa251391f50 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:23.869074 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-17013681-605e-44e6-9977-9aa251391f50 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:23.875821 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-17013681-605e-44e6-9977-9aa251391f50 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:23.876310 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-17013681-605e-44e6-9977-9aa251391f50 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:23.877074 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-17013681-605e-44e6-9977-9aa251391f50 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:23.877506 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-17013681-605e-44e6-9977-9aa251391f50 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:23.894094 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2f4dd820-ac3f-4a1e-a308-fbea731883a7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044666 Aug 04 10:30:23.894653 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 383/728] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:30:23 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:30:23.958860 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e6344890-c0e4-4c5e-91f1-c87fcfc203d3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:23.959365 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e6344890-c0e4-4c5e-91f1-c87fcfc203d3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:23.965601 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e6344890-c0e4-4c5e-91f1-c87fcfc203d3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:23.973363 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e6344890-c0e4-4c5e-91f1-c87fcfc203d3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:23.973363 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e6344890-c0e4-4c5e-91f1-c87fcfc203d3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:23.973363 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e6344890-c0e4-4c5e-91f1-c87fcfc203d3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:23.993969 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e6344890-c0e4-4c5e-91f1-c87fcfc203d3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:30:24.015476 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-17013681-605e-44e6-9977-9aa251391f50 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:24.025033 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-17013681-605e-44e6-9977-9aa251391f50 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1570 microversion: 2.1 time: 0.160184 Aug 04 10:30:24.025721 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 346/729] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:23 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:30:24.224848 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e6344890-c0e4-4c5e-91f1-c87fcfc203d3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 204 len: 0 microversion: 2.1 time: 0.269974 Aug 04 10:30:24.225415 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 384/730] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:30:23 2022] DELETE /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 10:30:24.235255 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9a27f734-e5a2-4d72-8706-e96d6b2af3c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:24.235875 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9a27f734-e5a2-4d72-8706-e96d6b2af3c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:24.242992 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a27f734-e5a2-4d72-8706-e96d6b2af3c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:24.243175 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a27f734-e5a2-4d72-8706-e96d6b2af3c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:24.243913 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a27f734-e5a2-4d72-8706-e96d6b2af3c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:24.244384 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a27f734-e5a2-4d72-8706-e96d6b2af3c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:24.372048 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9a27f734-e5a2-4d72-8706-e96d6b2af3c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:24.379488 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9a27f734-e5a2-4d72-8706-e96d6b2af3c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1681 microversion: 2.1 time: 0.149220 Aug 04 10:30:24.380069 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 347/731] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:24 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:25.050342 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-90ed75ec-9a95-4e27-9399-f609bd3c1625 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:25.051239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-90ed75ec-9a95-4e27-9399-f609bd3c1625 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:25.058395 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90ed75ec-9a95-4e27-9399-f609bd3c1625 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:25.058847 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90ed75ec-9a95-4e27-9399-f609bd3c1625 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:25.059611 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90ed75ec-9a95-4e27-9399-f609bd3c1625 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:25.060076 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-90ed75ec-9a95-4e27-9399-f609bd3c1625 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:25.199041 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-90ed75ec-9a95-4e27-9399-f609bd3c1625 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:25.206837 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-90ed75ec-9a95-4e27-9399-f609bd3c1625 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1570 microversion: 2.1 time: 0.160780 Aug 04 10:30:25.207430 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 385/732] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:25 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:25.401111 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-2562e1fe-92b6-4f56-9682-19d91d396d41 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:25.401717 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-2562e1fe-92b6-4f56-9682-19d91d396d41 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:25.408354 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2562e1fe-92b6-4f56-9682-19d91d396d41 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:25.408796 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2562e1fe-92b6-4f56-9682-19d91d396d41 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:25.409550 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2562e1fe-92b6-4f56-9682-19d91d396d41 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:25.409991 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2562e1fe-92b6-4f56-9682-19d91d396d41 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:25.759453 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-2562e1fe-92b6-4f56-9682-19d91d396d41 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:25.767438 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-2562e1fe-92b6-4f56-9682-19d91d396d41 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1681 microversion: 2.1 time: 0.370145 Aug 04 10:30:25.768053 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 348/733] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:25 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1681 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:26.228860 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cf326f58-6741-4d4d-9a9b-9795414a25f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:26.229476 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-cf326f58-6741-4d4d-9a9b-9795414a25f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:26.236418 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cf326f58-6741-4d4d-9a9b-9795414a25f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:26.236865 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cf326f58-6741-4d4d-9a9b-9795414a25f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:26.239016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cf326f58-6741-4d4d-9a9b-9795414a25f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:26.239016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cf326f58-6741-4d4d-9a9b-9795414a25f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:26.474425 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-cf326f58-6741-4d4d-9a9b-9795414a25f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:26.482644 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-cf326f58-6741-4d4d-9a9b-9795414a25f1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1570 microversion: 2.1 time: 0.258693 Aug 04 10:30:26.483214 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 386/734] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:26 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1570 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:26.790121 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-092f28c3-bb12-4c48-bcc5-eaed3b32a2ce tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:26.790730 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-092f28c3-bb12-4c48-bcc5-eaed3b32a2ce tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:26.797428 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-092f28c3-bb12-4c48-bcc5-eaed3b32a2ce tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:26.798087 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-092f28c3-bb12-4c48-bcc5-eaed3b32a2ce tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:26.799044 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-092f28c3-bb12-4c48-bcc5-eaed3b32a2ce tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:26.799508 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-092f28c3-bb12-4c48-bcc5-eaed3b32a2ce tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:26.887289 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-092f28c3-bb12-4c48-bcc5-eaed3b32a2ce tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:26.894784 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-092f28c3-bb12-4c48-bcc5-eaed3b32a2ce tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 200 len: 1614 microversion: 2.1 time: 0.108958 Aug 04 10:30:26.895355 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 349/735] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:26 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 1614 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:27.005158 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-84a58cee-ac3e-4c84-a13c-46162afca225 req-f6716bb9-3a3e-47fb-ba04-aa30e95184ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228506d2-27e6-4bab-991d-0695ea9543c3", "name": "network-vif-deleted", "tag": "adec20b2-5dff-4931-86b4-11c30465304f"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:27.018851 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-84a58cee-ac3e-4c84-a13c-46162afca225 req-f6716bb9-3a3e-47fb-ba04-aa30e95184ba service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:27.019392 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-84a58cee-ac3e-4c84-a13c-46162afca225 req-f6716bb9-3a3e-47fb-ba04-aa30e95184ba service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:27.031919 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-84a58cee-ac3e-4c84-a13c-46162afca225 req-f6716bb9-3a3e-47fb-ba04-aa30e95184ba service nova] Creating event network-vif-deleted:adec20b2-5dff-4931-86b4-11c30465304f for instance 228506d2-27e6-4bab-991d-0695ea9543c3 on hv-cinder-82660 Aug 04 10:30:27.043649 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-84a58cee-ac3e-4c84-a13c-46162afca225 req-f6716bb9-3a3e-47fb-ba04-aa30e95184ba service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042035 Aug 04 10:30:27.044391 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 387/736] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:27.504345 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-20e2f195-485d-4123-826f-e41d6e75e486 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:27.505442 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-20e2f195-485d-4123-826f-e41d6e75e486 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:27.515103 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-20e2f195-485d-4123-826f-e41d6e75e486 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:27.516437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-20e2f195-485d-4123-826f-e41d6e75e486 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:27.517432 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-20e2f195-485d-4123-826f-e41d6e75e486 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:27.518564 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-20e2f195-485d-4123-826f-e41d6e75e486 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:27.671422 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-20e2f195-485d-4123-826f-e41d6e75e486 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:27.680000 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-20e2f195-485d-4123-826f-e41d6e75e486 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1570 microversion: 2.1 time: 0.179709 Aug 04 10:30:27.680589 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 350/737] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:27 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:27.918532 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d8d48efe-3244-4de6-964e-f35250f37caa tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:27.919222 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d8d48efe-3244-4de6-964e-f35250f37caa tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:27.925851 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d8d48efe-3244-4de6-964e-f35250f37caa tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:27.926289 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d8d48efe-3244-4de6-964e-f35250f37caa tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:27.927047 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d8d48efe-3244-4de6-964e-f35250f37caa tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:27.927479 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d8d48efe-3244-4de6-964e-f35250f37caa tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:27.941634 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-d8d48efe-3244-4de6-964e-f35250f37caa tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] HTTP exception thrown: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d8d48efe-3244-4de6-964e-f35250f37caa tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Request method failure captured: Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 HTTP/1.1 Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656Tob97WbD_ZS5F2g-QN7pC61pEa9bei56wET8TrZeizeYQWOy31gmFZi3BtMbEG-sSRMiaAjSOk7-SIrWX3R_-R1F1qjTprnkQ7VwtSLuza02D0xNMbtZfy2jBcBSsmOWIl7uTSBWVqK40vdniduqG7S6ibX_f6b3y_2MqFav-ZhA Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:30:27.943461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:30:27.946016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:30:27.946016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:30:27.946016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:30:27.946016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:30:27.946016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:30:27.946016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:30:27.946016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:30:27.946016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: b680411b142642b7acc3585d2481f880 Aug 04 10:30:27.946016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:30:27.946016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:30:27.946016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:30:27.946016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '228506d2-27e6-4bab-991d-0695ea9543c3'} Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:30:27.946972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:30:27.948450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:27.950550 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d8d48efe-3244-4de6-964e-f35250f37caa tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Returning 404 to user: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:30:27.950550 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d8d48efe-3244-4de6-964e-f35250f37caa tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 404 len: 111 microversion: 2.1 time: 0.031281 Aug 04 10:30:27.950550 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 388/738] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:27 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:30:27.955157 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9f0d56e4-6083-4e72-a4f8-72bdb690eadb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '.version_select at 0x7fbaa4708430>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:27.974657 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9f0d56e4-6083-4e72-a4f8-72bdb690eadb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-139247792" status: 202 len: 0 microversion: 2.1 time: 0.023432 Aug 04 10:30:27.975205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 351/739] 10.222.0.72 () {58 vars in 1218 bytes} [Thu Aug 4 10:30:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-139247792 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:30:28.608938 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ce411bcd-ba5b-4b34-96f1-41e6e0b2e1ef tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Action: 'create', calling method: .version_select at 0x7fbaa4e4bd30>, body: {"keypair": {"name": "tempest-keypair-45067599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNrkc0FEROAGEm2V3+ctnoblk5fivJJge7znYDKXaSu6Ie5mx0mEViNyKP2GI1eO6mAoVJQ3EcDRwwhh7n15Q3sIBnfmRGC6VlEwGX9Wt/JRuxvOaVCxbJhSfnOxLPcpQ=="}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:28.624438 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-ce411bcd-ba5b-4b34-96f1-41e6e0b2e1ef tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:30:28.628194 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-ce411bcd-ba5b-4b34-96f1-41e6e0b2e1ef tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for user b680411b142642b7acc3585d2481f880 and project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:30:28.651056 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ce411bcd-ba5b-4b34-96f1-41e6e0b2e1ef tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.045975 Aug 04 10:30:28.651670 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 389/740] 10.222.0.72 () {60 vars in 1159 bytes} [Thu Aug 4 10:30:28 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:28.700322 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6ca87977-b98c-4b22-a7e6-2e1d11cc4ea1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:28.700931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6ca87977-b98c-4b22-a7e6-2e1d11cc4ea1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:28.706920 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ca87977-b98c-4b22-a7e6-2e1d11cc4ea1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:28.707377 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ca87977-b98c-4b22-a7e6-2e1d11cc4ea1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:28.708142 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ca87977-b98c-4b22-a7e6-2e1d11cc4ea1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:28.708568 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ca87977-b98c-4b22-a7e6-2e1d11cc4ea1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:28.858579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6ca87977-b98c-4b22-a7e6-2e1d11cc4ea1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:28.866681 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6ca87977-b98c-4b22-a7e6-2e1d11cc4ea1 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1570 microversion: 2.1 time: 0.170280 Aug 04 10:30:28.867300 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 352/741] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:28 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:29.888280 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d27a84ea-6f45-47e2-ba65-20f6bb494561 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:29.888907 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d27a84ea-6f45-47e2-ba65-20f6bb494561 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:29.896584 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d27a84ea-6f45-47e2-ba65-20f6bb494561 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:29.897026 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d27a84ea-6f45-47e2-ba65-20f6bb494561 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:29.897827 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d27a84ea-6f45-47e2-ba65-20f6bb494561 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:29.898293 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d27a84ea-6f45-47e2-ba65-20f6bb494561 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:30.014427 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-270662081", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "efa95d14-4335-4752-bcd1-62814f92872f"}], "security_groups": [{"name": "tempest-securitygroup--942916843"}], "key_name": "tempest-keypair-45067599", "user_data": "}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:30.040956 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d27a84ea-6f45-47e2-ba65-20f6bb494561 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:30.048842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d27a84ea-6f45-47e2-ba65-20f6bb494561 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1571 microversion: 2.1 time: 0.164712 Aug 04 10:30:30.049405 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 390/742] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:29 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:30.070564 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-81d2a97e-bb60-4b1a-9122-f22a685b6bfa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:30.071067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-81d2a97e-bb60-4b1a-9122-f22a685b6bfa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:30.078710 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-81d2a97e-bb60-4b1a-9122-f22a685b6bfa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:30.079157 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-81d2a97e-bb60-4b1a-9122-f22a685b6bfa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:30.079933 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-81d2a97e-bb60-4b1a-9122-f22a685b6bfa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:30.080408 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-81d2a97e-bb60-4b1a-9122-f22a685b6bfa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:30.113776 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-81d2a97e-bb60-4b1a-9122-f22a685b6bfa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117666) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 10:30:30.141095 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.network.neutron [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] validate_networks() for [('efa95d14-4335-4752-bcd1-62814f92872f', None, None, None, None, None)] {{(pid=117667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:30:30.183111 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-81d2a97e-bb60-4b1a-9122-f22a685b6bfa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "POST /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9/action" status: 202 len: 0 microversion: 2.1 time: 0.116843 Aug 04 10:30:30.183792 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 391/743] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:30:30 2022] POST /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:30:30.192541 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-af2c9157-7f7d-4fea-a329-ea118fcc03d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:30.193176 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-af2c9157-7f7d-4fea-a329-ea118fcc03d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:30.200505 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-af2c9157-7f7d-4fea-a329-ea118fcc03d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:30.200694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-af2c9157-7f7d-4fea-a329-ea118fcc03d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:30.201458 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-af2c9157-7f7d-4fea-a329-ea118fcc03d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:30.201942 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-af2c9157-7f7d-4fea-a329-ea118fcc03d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:30.435776 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-af2c9157-7f7d-4fea-a329-ea118fcc03d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:30.446463 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-af2c9157-7f7d-4fea-a329-ea118fcc03d3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1519 microversion: 2.1 time: 0.258234 Aug 04 10:30:30.447390 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 392/744] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:30 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1519 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:30:30.646293 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Flavor limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:30:30.646891 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Image limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:30:30.647494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Flavor pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:30:30.647900 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Image pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:30:30.648899 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:30:30.657639 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:30.658073 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:30.658856 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:30.659280 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:30.676690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:30:30.681137 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Getting quotas for user b680411b142642b7acc3585d2481f880 and project ae1e51ae816f4dc6b7dac8c2ddcf38bc. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:30:30.692374 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Going to run 1 instances... {{(pid=117667) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:30:30.694733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:30:30.741356 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-951aa530-90c1-499e-9361-5ceeba7524b6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.731528 Aug 04 10:30:30.742775 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 353/745] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:30:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 10:30:30.753533 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0ac23fc8-be1c-4b18-9fa5-7190c1afe281 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:30.754463 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0ac23fc8-be1c-4b18-9fa5-7190c1afe281 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:30.822631 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0ac23fc8-be1c-4b18-9fa5-7190c1afe281 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:30.831047 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0ac23fc8-be1c-4b18-9fa5-7190c1afe281 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1239 microversion: 2.1 time: 0.081346 Aug 04 10:30:30.831651 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 393/746] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:30 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:31.470135 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8bc745c4-15fb-4e87-a1f9-9d17654d0390 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:31.470822 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8bc745c4-15fb-4e87-a1f9-9d17654d0390 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:31.477644 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8bc745c4-15fb-4e87-a1f9-9d17654d0390 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:31.478085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8bc745c4-15fb-4e87-a1f9-9d17654d0390 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:31.478830 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8bc745c4-15fb-4e87-a1f9-9d17654d0390 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:31.479259 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8bc745c4-15fb-4e87-a1f9-9d17654d0390 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:31.616573 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8bc745c4-15fb-4e87-a1f9-9d17654d0390 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:31.624172 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8bc745c4-15fb-4e87-a1f9-9d17654d0390 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1521 microversion: 2.1 time: 0.158856 Aug 04 10:30:31.624737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 354/747] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:31 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:31.851897 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e7ad7f02-6463-4722-8cf4-2e8574ac0c2e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:31.852570 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e7ad7f02-6463-4722-8cf4-2e8574ac0c2e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:31.863739 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e7ad7f02-6463-4722-8cf4-2e8574ac0c2e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:31.864444 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e7ad7f02-6463-4722-8cf4-2e8574ac0c2e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:31.865896 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e7ad7f02-6463-4722-8cf4-2e8574ac0c2e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:31.866349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e7ad7f02-6463-4722-8cf4-2e8574ac0c2e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:31.942172 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e7ad7f02-6463-4722-8cf4-2e8574ac0c2e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:31.951748 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e7ad7f02-6463-4722-8cf4-2e8574ac0c2e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1299 microversion: 2.1 time: 0.103955 Aug 04 10:30:31.953109 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 394/748] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:31 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:32.648471 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-597277ef-cf6b-494b-9850-122cc4808d99 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:32.649007 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-597277ef-cf6b-494b-9850-122cc4808d99 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:32.655933 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-597277ef-cf6b-494b-9850-122cc4808d99 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:32.656757 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-597277ef-cf6b-494b-9850-122cc4808d99 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:32.657739 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-597277ef-cf6b-494b-9850-122cc4808d99 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:32.658395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-597277ef-cf6b-494b-9850-122cc4808d99 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:32.918187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-597277ef-cf6b-494b-9850-122cc4808d99 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:32.929476 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-597277ef-cf6b-494b-9850-122cc4808d99 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1577 microversion: 2.1 time: 0.287769 Aug 04 10:30:32.945239 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 355/749] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:32 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1577 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:32.979339 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5782410a-e644-4424-904a-bc2e89bf1f6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:32.979943 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5782410a-e644-4424-904a-bc2e89bf1f6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:32.996939 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5782410a-e644-4424-904a-bc2e89bf1f6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:32.997903 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5782410a-e644-4424-904a-bc2e89bf1f6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:33.002690 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5782410a-e644-4424-904a-bc2e89bf1f6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:33.003120 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5782410a-e644-4424-904a-bc2e89bf1f6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:33.008046 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:33.333699 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5782410a-e644-4424-904a-bc2e89bf1f6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:33.345158 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5782410a-e644-4424-904a-bc2e89bf1f6c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1364 microversion: 2.1 time: 0.371678 Aug 04 10:30:33.345765 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 395/750] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:32 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1364 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:33.542058 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-a84c6aa1-ba34-4cc1-9d04-943c930cce65 req-7e7ca965-6cab-442d-b641-f3059298b170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e129c5-a1f4-418e-a7c7-8840c88c20e9", "name": "network-vif-unplugged", "status": "completed", "tag": "99b65378-21c4-446f-87b5-bc67e1fde387"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:33.563947 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-a84c6aa1-ba34-4cc1-9d04-943c930cce65 req-7e7ca965-6cab-442d-b641-f3059298b170 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:33.564758 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-a84c6aa1-ba34-4cc1-9d04-943c930cce65 req-7e7ca965-6cab-442d-b641-f3059298b170 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:33.579874 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-a84c6aa1-ba34-4cc1-9d04-943c930cce65 req-7e7ca965-6cab-442d-b641-f3059298b170 service nova] Creating event network-vif-unplugged:99b65378-21c4-446f-87b5-bc67e1fde387 for instance 34e129c5-a1f4-418e-a7c7-8840c88c20e9 on hv-cinder-82660 Aug 04 10:30:33.586838 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-a84c6aa1-ba34-4cc1-9d04-943c930cce65 req-7e7ca965-6cab-442d-b641-f3059298b170 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049170 Aug 04 10:30:33.588904 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 356/751] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:33.716212 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-9f99709e-74bf-4ba1-8790-801c131ec669 req-1513291b-5984-433c-9179-478d583cab51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b55a1e93-26e7-4c91-bf51-5505f979d59b", "tag": "a7735c18-ebb1-4ef0-9d8f-72b98cc4238f"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:33.728493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-9f99709e-74bf-4ba1-8790-801c131ec669 req-1513291b-5984-433c-9179-478d583cab51 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:33.729210 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-9f99709e-74bf-4ba1-8790-801c131ec669 req-1513291b-5984-433c-9179-478d583cab51 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:33.741388 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-9f99709e-74bf-4ba1-8790-801c131ec669 req-1513291b-5984-433c-9179-478d583cab51 service nova] Creating event network-changed:a7735c18-ebb1-4ef0-9d8f-72b98cc4238f for instance b55a1e93-26e7-4c91-bf51-5505f979d59b on hv-cinder-82660 Aug 04 10:30:33.747184 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-9f99709e-74bf-4ba1-8790-801c131ec669 req-1513291b-5984-433c-9179-478d583cab51 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111496 Aug 04 10:30:33.747789 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 396/752] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:33.955845 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-26f689be-351e-4dda-aeaa-8b492102f78c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:33.957898 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-26f689be-351e-4dda-aeaa-8b492102f78c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:33.968532 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-26f689be-351e-4dda-aeaa-8b492102f78c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:33.969125 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-26f689be-351e-4dda-aeaa-8b492102f78c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:33.970042 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-26f689be-351e-4dda-aeaa-8b492102f78c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:33.970471 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-26f689be-351e-4dda-aeaa-8b492102f78c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:34.128354 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-26f689be-351e-4dda-aeaa-8b492102f78c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:34.138625 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-26f689be-351e-4dda-aeaa-8b492102f78c tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1577 microversion: 2.1 time: 0.187750 Aug 04 10:30:34.139235 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 357/753] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:33 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:34.367833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-15df7319-366b-4892-84db-1d8ecd9772cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:34.368558 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-15df7319-366b-4892-84db-1d8ecd9772cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:34.374930 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-15df7319-366b-4892-84db-1d8ecd9772cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:34.375373 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-15df7319-366b-4892-84db-1d8ecd9772cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:34.376237 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-15df7319-366b-4892-84db-1d8ecd9772cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:34.376629 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-15df7319-366b-4892-84db-1d8ecd9772cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:34.514604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-15df7319-366b-4892-84db-1d8ecd9772cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:34.522464 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-15df7319-366b-4892-84db-1d8ecd9772cd tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1364 microversion: 2.1 time: 0.159431 Aug 04 10:30:34.523058 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 397/754] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:34 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:35.154873 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8e0eeb52-4776-4381-b0b5-7b6a8edc7e6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:35.155499 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8e0eeb52-4776-4381-b0b5-7b6a8edc7e6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:35.161494 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a6bc39a1-9fe5-4d79-ada8-64f515593b07 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:35.162289 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a6bc39a1-9fe5-4d79-ada8-64f515593b07 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:35.168677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6bc39a1-9fe5-4d79-ada8-64f515593b07 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:35.169264 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6bc39a1-9fe5-4d79-ada8-64f515593b07 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:35.170120 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6bc39a1-9fe5-4d79-ada8-64f515593b07 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:35.170651 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6bc39a1-9fe5-4d79-ada8-64f515593b07 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:35.173611 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8e0eeb52-4776-4381-b0b5-7b6a8edc7e6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:35.174104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8e0eeb52-4776-4381-b0b5-7b6a8edc7e6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:35.174912 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8e0eeb52-4776-4381-b0b5-7b6a8edc7e6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:35.175347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8e0eeb52-4776-4381-b0b5-7b6a8edc7e6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:35.287504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-8e0eeb52-4776-4381-b0b5-7b6a8edc7e6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lazy-loading 'services' on Instance uuid fd2293ba-55aa-43f6-a08d-06a3995d3fda {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:30:35.335944 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a6bc39a1-9fe5-4d79-ada8-64f515593b07 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:35.366652 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a6bc39a1-9fe5-4d79-ada8-64f515593b07 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1577 microversion: 2.1 time: 0.209139 Aug 04 10:30:35.368695 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 398/755] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:35 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:30:35.392371 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8e0eeb52-4776-4381-b0b5-7b6a8edc7e6c tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "DELETE /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-volume_attachments/b4d0da5b-5e34-465d-a0ee-d57a2a0d4fa9" status: 202 len: 0 microversion: 2.1 time: 0.241567 Aug 04 10:30:35.393349 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 358/756] 10.222.0.72 () {58 vars in 1416 bytes} [Thu Aug 4 10:30:35 2022] DELETE /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-volume_attachments/b4d0da5b-5e34-465d-a0ee-d57a2a0d4fa9 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:30:35.408371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4bf9058b-65ea-4938-900d-d7f909886c8e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:35.411248 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4bf9058b-65ea-4938-900d-d7f909886c8e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:35.420133 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4bf9058b-65ea-4938-900d-d7f909886c8e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:35.420577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4bf9058b-65ea-4938-900d-d7f909886c8e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:35.421414 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4bf9058b-65ea-4938-900d-d7f909886c8e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:35.421847 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4bf9058b-65ea-4938-900d-d7f909886c8e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:35.463711 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4bf9058b-65ea-4938-900d-d7f909886c8e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065860 Aug 04 10:30:35.465276 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 399/757] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:30:35 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:35.545110 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b49fc423-7e55-4a5b-a348-784cb7a758f8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:35.547886 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b49fc423-7e55-4a5b-a348-784cb7a758f8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:35.555360 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b49fc423-7e55-4a5b-a348-784cb7a758f8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:35.557076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b49fc423-7e55-4a5b-a348-784cb7a758f8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:35.558146 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b49fc423-7e55-4a5b-a348-784cb7a758f8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:35.558570 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b49fc423-7e55-4a5b-a348-784cb7a758f8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:35.706472 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b49fc423-7e55-4a5b-a348-784cb7a758f8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:35.715000 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b49fc423-7e55-4a5b-a348-784cb7a758f8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1364 microversion: 2.1 time: 0.175824 Aug 04 10:30:35.715833 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 359/758] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:35 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:36.390012 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e046d465-f039-42bc-83a9-b172e015b070 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:36.391353 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e046d465-f039-42bc-83a9-b172e015b070 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:36.398031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e046d465-f039-42bc-83a9-b172e015b070 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:36.399105 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e046d465-f039-42bc-83a9-b172e015b070 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:36.399863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e046d465-f039-42bc-83a9-b172e015b070 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:36.400372 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e046d465-f039-42bc-83a9-b172e015b070 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:36.476525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a86958ba-a82d-497d-a7f5-5866caf112f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:36.478781 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a86958ba-a82d-497d-a7f5-5866caf112f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:36.482402 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:36.490074 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a86958ba-a82d-497d-a7f5-5866caf112f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:36.490702 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a86958ba-a82d-497d-a7f5-5866caf112f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:36.491471 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a86958ba-a82d-497d-a7f5-5866caf112f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:36.491931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a86958ba-a82d-497d-a7f5-5866caf112f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:36.532678 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a86958ba-a82d-497d-a7f5-5866caf112f9 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060185 Aug 04 10:30:36.533331 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 360/759] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:30:36 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 10:30:36.543738 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e046d465-f039-42bc-83a9-b172e015b070 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:36.551650 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e046d465-f039-42bc-83a9-b172e015b070 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1577 microversion: 2.1 time: 0.165704 Aug 04 10:30:36.552499 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 400/760] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:36 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:36.616374 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4220be89-e6f8-4bf7-8bcb-87d51f9f437f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:36.616898 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4220be89-e6f8-4bf7-8bcb-87d51f9f437f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:36.623005 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4220be89-e6f8-4bf7-8bcb-87d51f9f437f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:36.623671 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4220be89-e6f8-4bf7-8bcb-87d51f9f437f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:36.624498 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4220be89-e6f8-4bf7-8bcb-87d51f9f437f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:36.624932 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4220be89-e6f8-4bf7-8bcb-87d51f9f437f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:36.650626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4220be89-e6f8-4bf7-8bcb-87d51f9f437f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Going to try to terminate instance {{(pid=117667) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:30:36.678404 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:36.734917 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4220be89-e6f8-4bf7-8bcb-87d51f9f437f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "DELETE /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 204 len: 0 microversion: 2.1 time: 0.121670 Aug 04 10:30:36.735821 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 361/761] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:30:36 2022] DELETE /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 10:30:36.736555 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7fb107cc-9688-481f-bb67-d3f3a9d95d97 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:36.737168 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7fb107cc-9688-481f-bb67-d3f3a9d95d97 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:36.744352 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7fb107cc-9688-481f-bb67-d3f3a9d95d97 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:36.744918 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7fb107cc-9688-481f-bb67-d3f3a9d95d97 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:36.748010 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4b1611ec-bc16-45cd-9bb5-c1fb7f5cf437 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:36.748168 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7fb107cc-9688-481f-bb67-d3f3a9d95d97 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:36.748168 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7fb107cc-9688-481f-bb67-d3f3a9d95d97 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:36.748347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4b1611ec-bc16-45cd-9bb5-c1fb7f5cf437 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:36.753072 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b1611ec-bc16-45cd-9bb5-c1fb7f5cf437 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:36.753687 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b1611ec-bc16-45cd-9bb5-c1fb7f5cf437 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:36.754282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b1611ec-bc16-45cd-9bb5-c1fb7f5cf437 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:36.754729 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b1611ec-bc16-45cd-9bb5-c1fb7f5cf437 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:36.955949 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7fb107cc-9688-481f-bb67-d3f3a9d95d97 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:36.960401 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4b1611ec-bc16-45cd-9bb5-c1fb7f5cf437 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:36.964723 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7fb107cc-9688-481f-bb67-d3f3a9d95d97 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1364 microversion: 2.1 time: 0.232238 Aug 04 10:30:36.965402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 401/762] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:36 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:36.975786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4b1611ec-bc16-45cd-9bb5-c1fb7f5cf437 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1688 microversion: 2.1 time: 0.235086 Aug 04 10:30:36.977012 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 362/763] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:36 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1688 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:37.573902 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5bafcabc-f2e6-4a5a-a790-819fcca0e58f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:37.574520 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5bafcabc-f2e6-4a5a-a790-819fcca0e58f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:37.582255 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5bafcabc-f2e6-4a5a-a790-819fcca0e58f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:37.582715 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5bafcabc-f2e6-4a5a-a790-819fcca0e58f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:37.583505 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5bafcabc-f2e6-4a5a-a790-819fcca0e58f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:37.583968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5bafcabc-f2e6-4a5a-a790-819fcca0e58f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:37.736389 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-a3f67df6-42b1-406d-8d8e-8415322c46d5 req-e41687ac-88b7-4fc6-8650-7cfa25fc789b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b55a1e93-26e7-4c91-bf51-5505f979d59b", "name": "network-vif-plugged", "status": "completed", "tag": "a7735c18-ebb1-4ef0-9d8f-72b98cc4238f"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:37.738249 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5bafcabc-f2e6-4a5a-a790-819fcca0e58f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:37.749776 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5bafcabc-f2e6-4a5a-a790-819fcca0e58f tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1577 microversion: 2.1 time: 0.180253 Aug 04 10:30:37.750284 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 402/764] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:37 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:37.755173 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-a3f67df6-42b1-406d-8d8e-8415322c46d5 req-e41687ac-88b7-4fc6-8650-7cfa25fc789b service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:37.755604 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-a3f67df6-42b1-406d-8d8e-8415322c46d5 req-e41687ac-88b7-4fc6-8650-7cfa25fc789b service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:37.768469 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-a3f67df6-42b1-406d-8d8e-8415322c46d5 req-e41687ac-88b7-4fc6-8650-7cfa25fc789b service nova] Creating event network-vif-plugged:a7735c18-ebb1-4ef0-9d8f-72b98cc4238f for instance b55a1e93-26e7-4c91-bf51-5505f979d59b on hv-cinder-82660 Aug 04 10:30:37.775210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-a3f67df6-42b1-406d-8d8e-8415322c46d5 req-e41687ac-88b7-4fc6-8650-7cfa25fc789b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043421 Aug 04 10:30:37.775820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 363/765] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:30:37.988710 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e9555490-c422-45d5-b354-21c9ef879e01 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:37.989378 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e9555490-c422-45d5-b354-21c9ef879e01 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:37.996817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e9555490-c422-45d5-b354-21c9ef879e01 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:37.997266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e9555490-c422-45d5-b354-21c9ef879e01 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:37.998091 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e9555490-c422-45d5-b354-21c9ef879e01 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:37.998522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e9555490-c422-45d5-b354-21c9ef879e01 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:37.999390 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-38ff5284-56b9-4b33-9a15-346e4c1751ce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:38.000166 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-38ff5284-56b9-4b33-9a15-346e4c1751ce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:38.006754 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-38ff5284-56b9-4b33-9a15-346e4c1751ce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:38.007203 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-38ff5284-56b9-4b33-9a15-346e4c1751ce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:38.008062 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-38ff5284-56b9-4b33-9a15-346e4c1751ce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:38.008506 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-38ff5284-56b9-4b33-9a15-346e4c1751ce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:38.192409 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e9555490-c422-45d5-b354-21c9ef879e01 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:38.200578 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e9555490-c422-45d5-b354-21c9ef879e01 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1364 microversion: 2.1 time: 0.215857 Aug 04 10:30:38.201131 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 403/766] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:37 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:38.203650 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-38ff5284-56b9-4b33-9a15-346e4c1751ce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:38.213370 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-38ff5284-56b9-4b33-9a15-346e4c1751ce tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1688 microversion: 2.1 time: 0.218144 Aug 04 10:30:38.213940 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 364/767] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:37 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1688 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:30:38.770778 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-24a6161e-6ca3-424b-98a2-b3fa89e14e08 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:38.771382 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-24a6161e-6ca3-424b-98a2-b3fa89e14e08 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:38.778612 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-24a6161e-6ca3-424b-98a2-b3fa89e14e08 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:38.779066 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-24a6161e-6ca3-424b-98a2-b3fa89e14e08 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:38.779828 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-24a6161e-6ca3-424b-98a2-b3fa89e14e08 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:38.780318 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-24a6161e-6ca3-424b-98a2-b3fa89e14e08 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:38.918547 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-24a6161e-6ca3-424b-98a2-b3fa89e14e08 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:38.926280 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-24a6161e-6ca3-424b-98a2-b3fa89e14e08 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1577 microversion: 2.1 time: 0.159152 Aug 04 10:30:38.926831 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 404/768] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:38 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:39.220322 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f099c09c-06c6-4e49-9a0a-ee39e1a789d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:39.220856 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f099c09c-06c6-4e49-9a0a-ee39e1a789d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:39.228366 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f099c09c-06c6-4e49-9a0a-ee39e1a789d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:39.228818 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f099c09c-06c6-4e49-9a0a-ee39e1a789d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:39.229587 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f099c09c-06c6-4e49-9a0a-ee39e1a789d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:39.230016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f099c09c-06c6-4e49-9a0a-ee39e1a789d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:39.235298 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2b17986a-bf74-47fe-9be3-49deadf27e02 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:39.235904 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2b17986a-bf74-47fe-9be3-49deadf27e02 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:39.242926 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2b17986a-bf74-47fe-9be3-49deadf27e02 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:39.244927 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2b17986a-bf74-47fe-9be3-49deadf27e02 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:39.245923 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2b17986a-bf74-47fe-9be3-49deadf27e02 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:39.246598 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2b17986a-bf74-47fe-9be3-49deadf27e02 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:39.436543 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f099c09c-06c6-4e49-9a0a-ee39e1a789d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:39.441160 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2b17986a-bf74-47fe-9be3-49deadf27e02 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:39.445303 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f099c09c-06c6-4e49-9a0a-ee39e1a789d7 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1364 microversion: 2.1 time: 0.227832 Aug 04 10:30:39.445889 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 365/769] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:39 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:39.450561 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2b17986a-bf74-47fe-9be3-49deadf27e02 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1688 microversion: 2.1 time: 0.219056 Aug 04 10:30:39.451391 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 405/770] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:39 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1688 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:39.947936 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-92e4907f-d3e9-46a9-9039-bd7721e80a1b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:39.948712 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-92e4907f-d3e9-46a9-9039-bd7721e80a1b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:39.954923 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-92e4907f-d3e9-46a9-9039-bd7721e80a1b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:39.955421 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-92e4907f-d3e9-46a9-9039-bd7721e80a1b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:39.956208 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-92e4907f-d3e9-46a9-9039-bd7721e80a1b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:39.956646 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-92e4907f-d3e9-46a9-9039-bd7721e80a1b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:40.089942 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-92e4907f-d3e9-46a9-9039-bd7721e80a1b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:40.099353 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-92e4907f-d3e9-46a9-9039-bd7721e80a1b tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1577 microversion: 2.1 time: 0.155902 Aug 04 10:30:40.104098 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 366/771] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:39 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:40.474831 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-414bed82-ca50-4eb6-8463-177133640c3f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:40.476138 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-414bed82-ca50-4eb6-8463-177133640c3f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:40.481043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f3df601b-5350-449e-90b6-e9de87018af3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:40.481687 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f3df601b-5350-449e-90b6-e9de87018af3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:40.483117 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-414bed82-ca50-4eb6-8463-177133640c3f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:40.483745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-414bed82-ca50-4eb6-8463-177133640c3f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:40.484745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-414bed82-ca50-4eb6-8463-177133640c3f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:40.485187 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-414bed82-ca50-4eb6-8463-177133640c3f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:40.488181 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f3df601b-5350-449e-90b6-e9de87018af3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:40.488674 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f3df601b-5350-449e-90b6-e9de87018af3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:40.489758 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f3df601b-5350-449e-90b6-e9de87018af3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:40.490275 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f3df601b-5350-449e-90b6-e9de87018af3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:40.667841 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:40.684211 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-414bed82-ca50-4eb6-8463-177133640c3f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:40.690258 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f3df601b-5350-449e-90b6-e9de87018af3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:40.692467 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=6 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:40.694315 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-414bed82-ca50-4eb6-8463-177133640c3f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1688 microversion: 2.1 time: 0.223485 Aug 04 10:30:40.695322 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 406/772] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:40 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1688 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:40.699910 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f3df601b-5350-449e-90b6-e9de87018af3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1364 microversion: 2.1 time: 0.225630 Aug 04 10:30:40.700507 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 367/773] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:40 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:30:41.120682 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0263bf52-7bf0-4796-9f00-38cedb7a3ba3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:41.121319 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0263bf52-7bf0-4796-9f00-38cedb7a3ba3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:41.123375 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=6 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:41.129313 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0263bf52-7bf0-4796-9f00-38cedb7a3ba3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:41.129763 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0263bf52-7bf0-4796-9f00-38cedb7a3ba3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:41.130563 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0263bf52-7bf0-4796-9f00-38cedb7a3ba3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:41.130964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0263bf52-7bf0-4796-9f00-38cedb7a3ba3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:41.323423 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0263bf52-7bf0-4796-9f00-38cedb7a3ba3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:41.332218 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0263bf52-7bf0-4796-9f00-38cedb7a3ba3 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1577 microversion: 2.1 time: 0.215153 Aug 04 10:30:41.344374 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 407/774] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:41 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1577 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:41.715098 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d7cc571d-3c6d-43d1-92f9-3c2bfd6b8afc tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:41.715763 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-d7cc571d-3c6d-43d1-92f9-3c2bfd6b8afc tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:41.720743 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-38c848d4-f5ee-4033-af19-86b694b0f4c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:41.721356 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-38c848d4-f5ee-4033-af19-86b694b0f4c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:41.722672 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d7cc571d-3c6d-43d1-92f9-3c2bfd6b8afc tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:41.723125 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d7cc571d-3c6d-43d1-92f9-3c2bfd6b8afc tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:41.723885 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d7cc571d-3c6d-43d1-92f9-3c2bfd6b8afc tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:41.724343 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d7cc571d-3c6d-43d1-92f9-3c2bfd6b8afc tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:41.728724 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-38c848d4-f5ee-4033-af19-86b694b0f4c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:41.729188 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-38c848d4-f5ee-4033-af19-86b694b0f4c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:41.729950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-38c848d4-f5ee-4033-af19-86b694b0f4c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:41.730393 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-38c848d4-f5ee-4033-af19-86b694b0f4c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:41.929607 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-d7cc571d-3c6d-43d1-92f9-3c2bfd6b8afc tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:41.938720 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-38c848d4-f5ee-4033-af19-86b694b0f4c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:41.940593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d7cc571d-3c6d-43d1-92f9-3c2bfd6b8afc tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1688 microversion: 2.1 time: 0.229207 Aug 04 10:30:41.941099 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 368/775] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:41 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1688 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:30:41.952012 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-38c848d4-f5ee-4033-af19-86b694b0f4c3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1364 microversion: 2.1 time: 0.234976 Aug 04 10:30:41.955096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 408/776] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:41 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:42.167022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-cd19a6b1-6799-4cdd-9c7b-e3b9a308c47e req-2e49586b-bfad-4ad6-b6f0-40d77f5cf4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2293ba-55aa-43f6-a08d-06a3995d3fda", "name": "network-vif-deleted", "tag": "639fe804-03ce-41d5-8378-a5c1423f8ab2"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:42.177859 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-cd19a6b1-6799-4cdd-9c7b-e3b9a308c47e req-2e49586b-bfad-4ad6-b6f0-40d77f5cf4f6 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:42.178476 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-cd19a6b1-6799-4cdd-9c7b-e3b9a308c47e req-2e49586b-bfad-4ad6-b6f0-40d77f5cf4f6 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:42.194512 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-cd19a6b1-6799-4cdd-9c7b-e3b9a308c47e req-2e49586b-bfad-4ad6-b6f0-40d77f5cf4f6 service nova] Creating event network-vif-deleted:639fe804-03ce-41d5-8378-a5c1423f8ab2 for instance fd2293ba-55aa-43f6-a08d-06a3995d3fda on hv-cinder-82660 Aug 04 10:30:42.202192 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-cd19a6b1-6799-4cdd-9c7b-e3b9a308c47e req-2e49586b-bfad-4ad6-b6f0-40d77f5cf4f6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040844 Aug 04 10:30:42.206315 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 369/777] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:42.354399 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fdcea56a-a0d4-43dd-8e8d-af42bb360a12 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:42.354946 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fdcea56a-a0d4-43dd-8e8d-af42bb360a12 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:42.367626 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fdcea56a-a0d4-43dd-8e8d-af42bb360a12 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:42.368097 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fdcea56a-a0d4-43dd-8e8d-af42bb360a12 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:42.369674 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fdcea56a-a0d4-43dd-8e8d-af42bb360a12 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:42.370105 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fdcea56a-a0d4-43dd-8e8d-af42bb360a12 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:42.503764 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fdcea56a-a0d4-43dd-8e8d-af42bb360a12 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:42.511363 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fdcea56a-a0d4-43dd-8e8d-af42bb360a12 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1577 microversion: 2.1 time: 0.161660 Aug 04 10:30:42.512061 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 409/778] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:42 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:42.961651 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-bd3539ca-43a3-4564-a0c2-ea27b1510eab tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:42.962249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-bd3539ca-43a3-4564-a0c2-ea27b1510eab tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:42.971436 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd3539ca-43a3-4564-a0c2-ea27b1510eab tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:42.972358 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd3539ca-43a3-4564-a0c2-ea27b1510eab tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:42.973384 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd3539ca-43a3-4564-a0c2-ea27b1510eab tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:42.974114 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bd3539ca-43a3-4564-a0c2-ea27b1510eab tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:42.974900 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-87fb147e-7fba-4137-8c84-0a0d91fae00a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:42.975530 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-87fb147e-7fba-4137-8c84-0a0d91fae00a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:42.993262 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-87fb147e-7fba-4137-8c84-0a0d91fae00a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:42.993858 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-87fb147e-7fba-4137-8c84-0a0d91fae00a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:42.994715 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-87fb147e-7fba-4137-8c84-0a0d91fae00a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:42.995226 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-87fb147e-7fba-4137-8c84-0a0d91fae00a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:43.083256 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bd3539ca-43a3-4564-a0c2-ea27b1510eab tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:43.094222 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-bd3539ca-43a3-4564-a0c2-ea27b1510eab tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1329 microversion: 2.1 time: 0.136721 Aug 04 10:30:43.094782 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 370/779] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:42 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1329 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:43.159640 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-87fb147e-7fba-4137-8c84-0a0d91fae00a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:43.167465 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-87fb147e-7fba-4137-8c84-0a0d91fae00a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1554 microversion: 2.1 time: 0.196591 Aug 04 10:30:43.168095 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 410/780] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:42 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1554 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:30:43.188016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d7096ecf-7511-41eb-8a91-b6101e7c85d8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:43.188515 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-d7096ecf-7511-41eb-8a91-b6101e7c85d8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:43.194537 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d7096ecf-7511-41eb-8a91-b6101e7c85d8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:43.194982 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d7096ecf-7511-41eb-8a91-b6101e7c85d8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:43.195774 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d7096ecf-7511-41eb-8a91-b6101e7c85d8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:43.196231 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-d7096ecf-7511-41eb-8a91-b6101e7c85d8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:43.274484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d7096ecf-7511-41eb-8a91-b6101e7c85d8 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090328 Aug 04 10:30:43.275878 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 371/781] 10.222.0.72 () {58 vars in 1275 bytes} [Thu Aug 4 10:30:43 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:43.533678 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5ed593eb-f3e3-4f3a-b5ea-9f3661b41faa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:43.535073 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5ed593eb-f3e3-4f3a-b5ea-9f3661b41faa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:43.544002 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5ed593eb-f3e3-4f3a-b5ea-9f3661b41faa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:43.544763 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5ed593eb-f3e3-4f3a-b5ea-9f3661b41faa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:43.545788 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5ed593eb-f3e3-4f3a-b5ea-9f3661b41faa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:43.546441 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5ed593eb-f3e3-4f3a-b5ea-9f3661b41faa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:43.644861 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-ed801922-87df-4713-aaf0-14df3b532c98 req-00811a37-2c28-44a4-b728-6161d9d3d901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e129c5-a1f4-418e-a7c7-8840c88c20e9", "name": "network-vif-plugged", "status": "completed", "tag": "99b65378-21c4-446f-87b5-bc67e1fde387"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:43.657460 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-ed801922-87df-4713-aaf0-14df3b532c98 req-00811a37-2c28-44a4-b728-6161d9d3d901 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:43.661013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-ed801922-87df-4713-aaf0-14df3b532c98 req-00811a37-2c28-44a4-b728-6161d9d3d901 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:43.687974 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-ed801922-87df-4713-aaf0-14df3b532c98 req-00811a37-2c28-44a4-b728-6161d9d3d901 service nova] Creating event network-vif-plugged:99b65378-21c4-446f-87b5-bc67e1fde387 for instance 34e129c5-a1f4-418e-a7c7-8840c88c20e9 on hv-cinder-82660 Aug 04 10:30:43.693385 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-ed801922-87df-4713-aaf0-14df3b532c98 req-00811a37-2c28-44a4-b728-6161d9d3d901 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052281 Aug 04 10:30:43.694011 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 372/782] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:30:43.704639 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5ed593eb-f3e3-4f3a-b5ea-9f3661b41faa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:43.712433 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5ed593eb-f3e3-4f3a-b5ea-9f3661b41faa tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1577 microversion: 2.1 time: 0.182654 Aug 04 10:30:43.713229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 411/783] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:43 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:44.115871 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-2ddb1583-18d7-41ca-a8b7-fa246a789c54 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:44.116767 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-2ddb1583-18d7-41ca-a8b7-fa246a789c54 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:44.123826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2ddb1583-18d7-41ca-a8b7-fa246a789c54 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:44.124300 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2ddb1583-18d7-41ca-a8b7-fa246a789c54 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:44.125049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2ddb1583-18d7-41ca-a8b7-fa246a789c54 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:44.125475 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2ddb1583-18d7-41ca-a8b7-fa246a789c54 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:44.156463 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2ddb1583-18d7-41ca-a8b7-fa246a789c54 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:44.156913 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2ddb1583-18d7-41ca-a8b7-fa246a789c54 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:44.157364 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-2ddb1583-18d7-41ca-a8b7-fa246a789c54 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lazy-loading 'fault' on Instance uuid fd2293ba-55aa-43f6-a08d-06a3995d3fda {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:30:44.202197 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-2ddb1583-18d7-41ca-a8b7-fa246a789c54 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:44.209940 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-2ddb1583-18d7-41ca-a8b7-fa246a789c54 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 200 len: 1334 microversion: 2.1 time: 0.098730 Aug 04 10:30:44.224807 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 373/784] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:44 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 1334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:44.274196 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-b2cbef8a-6a0b-4d02-9726-9d9e7f39d73d req-0a4167ba-1cff-4924-914f-ac04d36ab33b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b55a1e93-26e7-4c91-bf51-5505f979d59b", "tag": "a7735c18-ebb1-4ef0-9d8f-72b98cc4238f"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:44.286329 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-b2cbef8a-6a0b-4d02-9726-9d9e7f39d73d req-0a4167ba-1cff-4924-914f-ac04d36ab33b service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:44.286774 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-b2cbef8a-6a0b-4d02-9726-9d9e7f39d73d req-0a4167ba-1cff-4924-914f-ac04d36ab33b service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:44.300135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-b2cbef8a-6a0b-4d02-9726-9d9e7f39d73d req-0a4167ba-1cff-4924-914f-ac04d36ab33b service nova] Creating event network-changed:a7735c18-ebb1-4ef0-9d8f-72b98cc4238f for instance b55a1e93-26e7-4c91-bf51-5505f979d59b on hv-cinder-82660 Aug 04 10:30:44.305867 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-b2cbef8a-6a0b-4d02-9726-9d9e7f39d73d req-0a4167ba-1cff-4924-914f-ac04d36ab33b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035740 Aug 04 10:30:44.307173 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 412/785] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:44.736966 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-85addeb8-ae8c-4aa4-a8ec-17ff428486f9 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:44.738125 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-85addeb8-ae8c-4aa4-a8ec-17ff428486f9 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:44.745435 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-85addeb8-ae8c-4aa4-a8ec-17ff428486f9 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:44.745987 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-85addeb8-ae8c-4aa4-a8ec-17ff428486f9 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:44.746987 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-85addeb8-ae8c-4aa4-a8ec-17ff428486f9 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:44.747661 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-85addeb8-ae8c-4aa4-a8ec-17ff428486f9 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:44.893616 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-85addeb8-ae8c-4aa4-a8ec-17ff428486f9 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:44.902652 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-85addeb8-ae8c-4aa4-a8ec-17ff428486f9 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1564 microversion: 2.1 time: 0.170647 Aug 04 10:30:44.903312 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 374/786] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:44 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:45.235550 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fb787017-558c-4101-b7cb-9dba515910a0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:45.236315 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fb787017-558c-4101-b7cb-9dba515910a0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: fd2293ba-55aa-43f6-a08d-06a3995d3fda] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:45.243104 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb787017-558c-4101-b7cb-9dba515910a0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:45.243564 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb787017-558c-4101-b7cb-9dba515910a0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:45.248870 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb787017-558c-4101-b7cb-9dba515910a0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:45.248870 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb787017-558c-4101-b7cb-9dba515910a0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:45.250418 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:45.261926 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-fb787017-558c-4101-b7cb-9dba515910a0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] HTTP exception thrown: Instance fd2293ba-55aa-43f6-a08d-06a3995d3fda could not be found. Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fb787017-558c-4101-b7cb-9dba515910a0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Request method failure captured: Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda HTTP/1.1 Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656KqkyTpFin9pC6UUiZnxPdZxrNgZe8aKP2AQVBxtFZQjEPDOz2syoeapzmVECDJuwBzARYqZ1ypET-oDIEGI9g04Puz4edhq-MbhP7Na3of1Dv53H-wKi9amzmFumCavdT1HtBnGsw9vziY0TeEZywE9bNtJErPNB1ve5PDfuHqpw Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 2a801dbffe56474d96c2abea31fd2fdc Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:30:45.263591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:30:45.265107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:30:45.265107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:30:45.265107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 2a801dbffe56474d96c2abea31fd2fdc Aug 04 10:30:45.265107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:30:45.265107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-ServerRescueNegativeTestJSON-532732172-project Aug 04 10:30:45.265107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:30:45.265107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:30:45.265107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: 84b748f30ebc4c5aa2af6ddcd86037cd Aug 04 10:30:45.265107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-ServerRescueNegativeTestJSON-532732172-project Aug 04 10:30:45.265107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:30:45.265107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance fd2293ba-55aa-43f6-a08d-06a3995d3fda could not be found. Aug 04 10:30:45.265107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': 'fd2293ba-55aa-43f6-a08d-06a3995d3fda'} Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd2293ba-55aa-43f6-a08d-06a3995d3fda could not be found. Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:30:45.267536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd2293ba-55aa-43f6-a08d-06a3995d3fda could not be found. Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd2293ba-55aa-43f6-a08d-06a3995d3fda could not be found. Aug 04 10:30:45.270451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:45.272394 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fb787017-558c-4101-b7cb-9dba515910a0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Returning 404 to user: Instance fd2293ba-55aa-43f6-a08d-06a3995d3fda could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:30:45.272394 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fb787017-558c-4101-b7cb-9dba515910a0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda" status: 404 len: 111 microversion: 2.1 time: 0.035867 Aug 04 10:30:45.272394 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 413/787] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:45 2022] GET /compute/v2.1/servers/fd2293ba-55aa-43f6-a08d-06a3995d3fda => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:30:45.281261 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-98993f44-7bc9-4f0f-a520-68f5dcedcac0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '.version_select at 0x7fbaa49455e0>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:45.306540 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-98993f44-7bc9-4f0f-a520-68f5dcedcac0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753184354" status: 202 len: 0 microversion: 2.1 time: 0.030001 Aug 04 10:30:45.307430 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 375/788] 10.222.0.72 () {58 vars in 1221 bytes} [Thu Aug 4 10:30:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753184354 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:30:48.464926 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c4a7b841-1973-426c-bebc-54a88ebea02a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:48.465442 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c4a7b841-1973-426c-bebc-54a88ebea02a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:48.472239 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c4a7b841-1973-426c-bebc-54a88ebea02a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:48.472688 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c4a7b841-1973-426c-bebc-54a88ebea02a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:48.473478 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c4a7b841-1973-426c-bebc-54a88ebea02a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:48.473909 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c4a7b841-1973-426c-bebc-54a88ebea02a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:48.500291 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c4a7b841-1973-426c-bebc-54a88ebea02a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:30:48.558876 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:48.576673 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c4a7b841-1973-426c-bebc-54a88ebea02a tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 204 len: 0 microversion: 2.1 time: 0.115175 Aug 04 10:30:48.577608 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 414/789] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:30:48 2022] DELETE /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:30:48.585935 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9357a10a-fe11-4501-86ae-e12b6780628e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:48.586545 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9357a10a-fe11-4501-86ae-e12b6780628e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:48.593425 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9357a10a-fe11-4501-86ae-e12b6780628e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:48.593875 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9357a10a-fe11-4501-86ae-e12b6780628e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:48.594799 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9357a10a-fe11-4501-86ae-e12b6780628e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:48.595517 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9357a10a-fe11-4501-86ae-e12b6780628e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:48.748865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9357a10a-fe11-4501-86ae-e12b6780628e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:48.756397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9357a10a-fe11-4501-86ae-e12b6780628e tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1508 microversion: 2.1 time: 0.174815 Aug 04 10:30:48.756902 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 376/790] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:48 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:49.779118 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fb961b5f-a1f7-4cd1-b97d-21db8791707f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:49.779857 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fb961b5f-a1f7-4cd1-b97d-21db8791707f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:49.786869 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb961b5f-a1f7-4cd1-b97d-21db8791707f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:49.787320 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb961b5f-a1f7-4cd1-b97d-21db8791707f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:49.788203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb961b5f-a1f7-4cd1-b97d-21db8791707f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:49.788636 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fb961b5f-a1f7-4cd1-b97d-21db8791707f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:49.919578 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fb961b5f-a1f7-4cd1-b97d-21db8791707f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:49.927881 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fb961b5f-a1f7-4cd1-b97d-21db8791707f tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1508 microversion: 2.1 time: 0.153838 Aug 04 10:30:49.928573 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 415/791] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:49 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:50.948558 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-3b986cc5-5bbf-42a3-8c5c-d1c1d2a44236 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:50.949177 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-3b986cc5-5bbf-42a3-8c5c-d1c1d2a44236 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:50.957239 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3b986cc5-5bbf-42a3-8c5c-d1c1d2a44236 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:50.957239 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3b986cc5-5bbf-42a3-8c5c-d1c1d2a44236 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:50.957501 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3b986cc5-5bbf-42a3-8c5c-d1c1d2a44236 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:50.957764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3b986cc5-5bbf-42a3-8c5c-d1c1d2a44236 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:51.115398 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-3b986cc5-5bbf-42a3-8c5c-d1c1d2a44236 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:51.128378 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-373f0cc7-28bd-427c-9baf-d55b4921018e req-544830dc-615e-46b6-b404-2ec98ddbf7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78fe279-9634-4426-8cab-5995ab7707a4", "name": "network-vif-deleted", "tag": "10285606-ce60-4931-8535-fc691ea023a3"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:51.136899 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-3b986cc5-5bbf-42a3-8c5c-d1c1d2a44236 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 200 len: 1508 microversion: 2.1 time: 0.192106 Aug 04 10:30:51.138044 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 377/792] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:50 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:51.142524 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-373f0cc7-28bd-427c-9baf-d55b4921018e req-544830dc-615e-46b6-b404-2ec98ddbf7bd service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:51.143266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-373f0cc7-28bd-427c-9baf-d55b4921018e req-544830dc-615e-46b6-b404-2ec98ddbf7bd service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:51.160084 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-373f0cc7-28bd-427c-9baf-d55b4921018e req-544830dc-615e-46b6-b404-2ec98ddbf7bd service nova] Creating event network-vif-deleted:10285606-ce60-4931-8535-fc691ea023a3 for instance d78fe279-9634-4426-8cab-5995ab7707a4 on hv-cinder-82660 Aug 04 10:30:51.164950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-373f0cc7-28bd-427c-9baf-d55b4921018e req-544830dc-615e-46b6-b404-2ec98ddbf7bd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040755 Aug 04 10:30:51.166234 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 416/793] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:30:51.537832 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-92270c40-5ec6-42aa-8717-83c3fe1f2e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:51.538399 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-92270c40-5ec6-42aa-8717-83c3fe1f2e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:51.545284 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-92270c40-5ec6-42aa-8717-83c3fe1f2e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:51.545812 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-92270c40-5ec6-42aa-8717-83c3fe1f2e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:51.546690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-92270c40-5ec6-42aa-8717-83c3fe1f2e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:51.547255 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-92270c40-5ec6-42aa-8717-83c3fe1f2e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:51.570030 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-92270c40-5ec6-42aa-8717-83c3fe1f2e01 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b/ips" status: 200 len: 152 microversion: 2.20 time: 0.087921 Aug 04 10:30:51.570578 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 378/794] 10.222.0.72 () {60 vars in 1289 bytes} [Thu Aug 4 10:30:51 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b/ips => generated 152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:30:52.164959 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-72e0e88b-d84b-415c-87bc-33ba51fd9714 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:52.165554 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-72e0e88b-d84b-415c-87bc-33ba51fd9714 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: d78fe279-9634-4426-8cab-5995ab7707a4] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:52.172008 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-72e0e88b-d84b-415c-87bc-33ba51fd9714 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:52.172526 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-72e0e88b-d84b-415c-87bc-33ba51fd9714 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:52.173282 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-72e0e88b-d84b-415c-87bc-33ba51fd9714 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:52.173713 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-72e0e88b-d84b-415c-87bc-33ba51fd9714 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:52.188973 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-72e0e88b-d84b-415c-87bc-33ba51fd9714 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] HTTP exception thrown: Instance d78fe279-9634-4426-8cab-5995ab7707a4 could not be found. Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-72e0e88b-d84b-415c-87bc-33ba51fd9714 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Request method failure captured: Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 HTTP/1.1 Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656KqkyTpFin9pC6UUiZnxPdZxrNgZe8aKP2AQVBxtFZQjEPDOz2syoeapzmVECDJuwBzARYqZ1ypET-oDIEGI9g04Puz4edhq-MbhP7Na3of1Dv53H-wKi9amzmFumCavdT1HtBnGsw9vziY0TeEZywE9bNtJErPNB1ve5PDfuHqpw Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 2a801dbffe56474d96c2abea31fd2fdc Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:30:52.190543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:30:52.192064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:30:52.192064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:30:52.192064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 2a801dbffe56474d96c2abea31fd2fdc Aug 04 10:30:52.192064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:30:52.192064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-ServerRescueNegativeTestJSON-532732172-project Aug 04 10:30:52.192064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:30:52.192064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:30:52.192064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: 84b748f30ebc4c5aa2af6ddcd86037cd Aug 04 10:30:52.192064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-ServerRescueNegativeTestJSON-532732172-project Aug 04 10:30:52.192064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:30:52.192064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance d78fe279-9634-4426-8cab-5995ab7707a4 could not be found. Aug 04 10:30:52.192064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': 'd78fe279-9634-4426-8cab-5995ab7707a4'} Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d78fe279-9634-4426-8cab-5995ab7707a4 could not be found. Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:30:52.192921 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d78fe279-9634-4426-8cab-5995ab7707a4 could not be found. Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d78fe279-9634-4426-8cab-5995ab7707a4 could not be found. Aug 04 10:30:52.194110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:52.195156 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-72e0e88b-d84b-415c-87bc-33ba51fd9714 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Returning 404 to user: Instance d78fe279-9634-4426-8cab-5995ab7707a4 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:30:52.195156 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-72e0e88b-d84b-415c-87bc-33ba51fd9714 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4" status: 404 len: 111 microversion: 2.1 time: 0.031801 Aug 04 10:30:52.195156 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 417/795] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:52 2022] GET /compute/v2.1/servers/d78fe279-9634-4426-8cab-5995ab7707a4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:30:52.201358 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8b4b53f4-0a8e-40d7-a815-fb6a745b21e0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:52.201909 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8b4b53f4-0a8e-40d7-a815-fb6a745b21e0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:52.208636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8b4b53f4-0a8e-40d7-a815-fb6a745b21e0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:52.209084 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8b4b53f4-0a8e-40d7-a815-fb6a745b21e0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:52.209843 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8b4b53f4-0a8e-40d7-a815-fb6a745b21e0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:52.210307 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8b4b53f4-0a8e-40d7-a815-fb6a745b21e0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:52.234973 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8b4b53f4-0a8e-40d7-a815-fb6a745b21e0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Going to try to terminate instance {{(pid=117667) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:30:52.268332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:52.309737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8b4b53f4-0a8e-40d7-a815-fb6a745b21e0 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 204 len: 0 microversion: 2.1 time: 0.112585 Aug 04 10:30:52.310328 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 379/796] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:30:52 2022] DELETE /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 10:30:52.318132 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c2faf068-5218-42f8-82b7-aecfb2df8a34 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:52.318816 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c2faf068-5218-42f8-82b7-aecfb2df8a34 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:52.325346 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c2faf068-5218-42f8-82b7-aecfb2df8a34 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:52.325793 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c2faf068-5218-42f8-82b7-aecfb2df8a34 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:52.326565 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c2faf068-5218-42f8-82b7-aecfb2df8a34 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:52.326981 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c2faf068-5218-42f8-82b7-aecfb2df8a34 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:52.457213 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c2faf068-5218-42f8-82b7-aecfb2df8a34 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:52.465383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c2faf068-5218-42f8-82b7-aecfb2df8a34 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.151016 Aug 04 10:30:52.465983 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 418/797] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:52 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:53.486737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-fffb6127-f4e3-4e5e-a768-f867a2603a94 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:53.487421 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-fffb6127-f4e3-4e5e-a768-f867a2603a94 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:53.494504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fffb6127-f4e3-4e5e-a768-f867a2603a94 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:53.494946 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fffb6127-f4e3-4e5e-a768-f867a2603a94 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:53.495698 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fffb6127-f4e3-4e5e-a768-f867a2603a94 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:53.496161 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fffb6127-f4e3-4e5e-a768-f867a2603a94 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:53.628172 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-fffb6127-f4e3-4e5e-a768-f867a2603a94 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:53.636369 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-fffb6127-f4e3-4e5e-a768-f867a2603a94 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.153787 Aug 04 10:30:53.636931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 380/798] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:53 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:54.161977 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7e8e7050-acdc-4ffb-9e83-63f8aa22212b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:54.162515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7e8e7050-acdc-4ffb-9e83-63f8aa22212b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:54.169647 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7e8e7050-acdc-4ffb-9e83-63f8aa22212b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:54.170092 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7e8e7050-acdc-4ffb-9e83-63f8aa22212b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:54.170850 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7e8e7050-acdc-4ffb-9e83-63f8aa22212b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:54.171284 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7e8e7050-acdc-4ffb-9e83-63f8aa22212b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:54.193960 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-7e8e7050-acdc-4ffb-9e83-63f8aa22212b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lazy-loading 'flavor' on Instance uuid 6d953ca9-81b0-46f6-af0f-22e198ddb24b {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:30:54.373965 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7e8e7050-acdc-4ffb-9e83-63f8aa22212b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "POST /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b/action" status: 202 len: 0 microversion: 2.20 time: 0.215826 Aug 04 10:30:54.374584 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 419/799] 10.222.0.72 () {62 vars in 1319 bytes} [Thu Aug 4 10:30:54 2022] POST /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:30:54.382647 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0beb2df6-163a-473b-a8fb-6a42e6fbbc49 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:54.383330 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0beb2df6-163a-473b-a8fb-6a42e6fbbc49 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:54.389919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0beb2df6-163a-473b-a8fb-6a42e6fbbc49 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:54.390369 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0beb2df6-163a-473b-a8fb-6a42e6fbbc49 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:54.391122 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0beb2df6-163a-473b-a8fb-6a42e6fbbc49 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:54.391554 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0beb2df6-163a-473b-a8fb-6a42e6fbbc49 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:54.521653 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0beb2df6-163a-473b-a8fb-6a42e6fbbc49 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:54.529607 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0beb2df6-163a-473b-a8fb-6a42e6fbbc49 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:54.531095 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0beb2df6-163a-473b-a8fb-6a42e6fbbc49 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:54.532267 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0beb2df6-163a-473b-a8fb-6a42e6fbbc49 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.153446 Aug 04 10:30:54.532814 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 381/800] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:30:54 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:30:54.657787 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-250fb579-866f-4c4b-a65d-f7d2e27b0e7d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:54.658484 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-250fb579-866f-4c4b-a65d-f7d2e27b0e7d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:54.664927 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-250fb579-866f-4c4b-a65d-f7d2e27b0e7d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:54.665895 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-250fb579-866f-4c4b-a65d-f7d2e27b0e7d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:54.666708 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-250fb579-866f-4c4b-a65d-f7d2e27b0e7d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:54.667143 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-250fb579-866f-4c4b-a65d-f7d2e27b0e7d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:54.795243 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-250fb579-866f-4c4b-a65d-f7d2e27b0e7d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:54.802940 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-250fb579-866f-4c4b-a65d-f7d2e27b0e7d tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1520 microversion: 2.1 time: 0.149403 Aug 04 10:30:54.803493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 420/801] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:54 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:55.555441 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b39d5481-8acc-4d59-a8bb-22244905eace tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:55.556101 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b39d5481-8acc-4d59-a8bb-22244905eace tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:55.559653 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-ce4dd3e4-725f-492b-b6f9-80454df7607c req-95b24e4e-7aad-4d8b-bd2f-e517c43b93c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef5108fd-663e-4c6a-bab7-2c706a4b0ebe", "name": "network-vif-deleted", "tag": "82ef3eba-27a2-4b68-aaaa-c836e1bc348b"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:30:55.563237 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b39d5481-8acc-4d59-a8bb-22244905eace tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:55.563642 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b39d5481-8acc-4d59-a8bb-22244905eace tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:55.564752 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b39d5481-8acc-4d59-a8bb-22244905eace tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:55.565383 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b39d5481-8acc-4d59-a8bb-22244905eace tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:55.569373 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-ce4dd3e4-725f-492b-b6f9-80454df7607c req-95b24e4e-7aad-4d8b-bd2f-e517c43b93c8 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:55.569820 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-ce4dd3e4-725f-492b-b6f9-80454df7607c req-95b24e4e-7aad-4d8b-bd2f-e517c43b93c8 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:55.581034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-ce4dd3e4-725f-492b-b6f9-80454df7607c req-95b24e4e-7aad-4d8b-bd2f-e517c43b93c8 service nova] Creating event network-vif-deleted:82ef3eba-27a2-4b68-aaaa-c836e1bc348b for instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe on hv-cinder-82660 Aug 04 10:30:55.586305 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-ce4dd3e4-725f-492b-b6f9-80454df7607c req-95b24e4e-7aad-4d8b-bd2f-e517c43b93c8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030379 Aug 04 10:30:55.588409 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 421/802] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:30:55.711857 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b39d5481-8acc-4d59-a8bb-22244905eace tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:55.719775 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b39d5481-8acc-4d59-a8bb-22244905eace tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:55.721313 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b39d5481-8acc-4d59-a8bb-22244905eace tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:55.722769 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b39d5481-8acc-4d59-a8bb-22244905eace tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.171975 Aug 04 10:30:55.723331 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 382/803] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:30:55 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:30:55.825261 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-65a8eb04-d720-4d56-96aa-349c32561ed5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:55.825955 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-65a8eb04-d720-4d56-96aa-349c32561ed5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:55.832361 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-65a8eb04-d720-4d56-96aa-349c32561ed5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:55.832814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-65a8eb04-d720-4d56-96aa-349c32561ed5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:55.833584 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-65a8eb04-d720-4d56-96aa-349c32561ed5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:55.834010 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-65a8eb04-d720-4d56-96aa-349c32561ed5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:55.867826 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-65a8eb04-d720-4d56-96aa-349c32561ed5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:55.868296 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-65a8eb04-d720-4d56-96aa-349c32561ed5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:55.869438 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-65a8eb04-d720-4d56-96aa-349c32561ed5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lazy-loading 'fault' on Instance uuid ef5108fd-663e-4c6a-bab7-2c706a4b0ebe {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:30:55.913734 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-65a8eb04-d720-4d56-96aa-349c32561ed5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b748f30ebc4c5aa2af6ddcd86037cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a801dbffe56474d96c2abea31fd2fdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:55.922245 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-65a8eb04-d720-4d56-96aa-349c32561ed5 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 200 len: 1311 microversion: 2.1 time: 0.101793 Aug 04 10:30:55.922824 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 422/804] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:55 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:56.746505 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-73e3da90-1bda-47fe-9df2-32b6d3c11b57 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:56.747268 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-73e3da90-1bda-47fe-9df2-32b6d3c11b57 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:56.753790 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-73e3da90-1bda-47fe-9df2-32b6d3c11b57 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:56.754228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-73e3da90-1bda-47fe-9df2-32b6d3c11b57 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:56.754972 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-73e3da90-1bda-47fe-9df2-32b6d3c11b57 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:56.755396 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-73e3da90-1bda-47fe-9df2-32b6d3c11b57 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:56.883307 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-73e3da90-1bda-47fe-9df2-32b6d3c11b57 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:56.891716 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-73e3da90-1bda-47fe-9df2-32b6d3c11b57 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:56.893931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-73e3da90-1bda-47fe-9df2-32b6d3c11b57 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:56.895102 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-73e3da90-1bda-47fe-9df2-32b6d3c11b57 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.153122 Aug 04 10:30:56.895671 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 383/805] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:30:56 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:30:56.943938 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c8e29c35-5969-4494-b273-9f996c34beb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:56.944554 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c8e29c35-5969-4494-b273-9f996c34beb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] [instance: ef5108fd-663e-4c6a-bab7-2c706a4b0ebe] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:56.951880 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c8e29c35-5969-4494-b273-9f996c34beb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:56.952350 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c8e29c35-5969-4494-b273-9f996c34beb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:56.953099 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c8e29c35-5969-4494-b273-9f996c34beb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:56.953526 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c8e29c35-5969-4494-b273-9f996c34beb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:56.967178 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-c8e29c35-5969-4494-b273-9f996c34beb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] HTTP exception thrown: Instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe could not be found. Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c8e29c35-5969-4494-b273-9f996c34beb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Request method failure captured: Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe HTTP/1.1 Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656KqkyTpFin9pC6UUiZnxPdZxrNgZe8aKP2AQVBxtFZQjEPDOz2syoeapzmVECDJuwBzARYqZ1ypET-oDIEGI9g04Puz4edhq-MbhP7Na3of1Dv53H-wKi9amzmFumCavdT1HtBnGsw9vziY0TeEZywE9bNtJErPNB1ve5PDfuHqpw Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 2a801dbffe56474d96c2abea31fd2fdc Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:30:56.969219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:30:56.970693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2a801dbffe56474d96c2abea31fd2fdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:30:56.970693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:30:56.970693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 2a801dbffe56474d96c2abea31fd2fdc Aug 04 10:30:56.970693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-532732172 Aug 04 10:30:56.970693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-ServerRescueNegativeTestJSON-532732172-project Aug 04 10:30:56.970693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:30:56.970693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:30:56.970693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: 84b748f30ebc4c5aa2af6ddcd86037cd Aug 04 10:30:56.970693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-ServerRescueNegativeTestJSON-532732172-project Aug 04 10:30:56.970693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:30:56.970693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe could not be found. Aug 04 10:30:56.970693 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': 'ef5108fd-663e-4c6a-bab7-2c706a4b0ebe'} Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe could not be found. Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:30:56.971515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe could not be found. Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe could not be found. Aug 04 10:30:56.972913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:30:56.974159 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c8e29c35-5969-4494-b273-9f996c34beb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] Returning 404 to user: Instance ef5108fd-663e-4c6a-bab7-2c706a4b0ebe could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:30:56.974159 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c8e29c35-5969-4494-b273-9f996c34beb2 tempest-ServerRescueNegativeTestJSON-532732172 tempest-ServerRescueNegativeTestJSON-532732172-project] 10.222.0.72 "GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe" status: 404 len: 111 microversion: 2.1 time: 0.030673 Aug 04 10:30:56.974159 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 423/806] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:30:56 2022] GET /compute/v2.1/servers/ef5108fd-663e-4c6a-bab7-2c706a4b0ebe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:30:57.918334 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-039efd9f-55d5-4ad0-b94e-532977f5bbdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:57.918939 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-039efd9f-55d5-4ad0-b94e-532977f5bbdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:57.925461 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-039efd9f-55d5-4ad0-b94e-532977f5bbdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:57.926159 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-039efd9f-55d5-4ad0-b94e-532977f5bbdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:57.926934 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-039efd9f-55d5-4ad0-b94e-532977f5bbdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:57.927369 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-039efd9f-55d5-4ad0-b94e-532977f5bbdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:58.057936 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-039efd9f-55d5-4ad0-b94e-532977f5bbdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:58.066092 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-039efd9f-55d5-4ad0-b94e-532977f5bbdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:58.067672 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-039efd9f-55d5-4ad0-b94e-532977f5bbdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:58.068903 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-039efd9f-55d5-4ad0-b94e-532977f5bbdc tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.154531 Aug 04 10:30:58.069665 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 384/807] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:30:57 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:30:59.091882 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-467bf3db-8568-459b-b7ce-2b27df60e96f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:59.094011 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-467bf3db-8568-459b-b7ce-2b27df60e96f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:30:59.101457 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-467bf3db-8568-459b-b7ce-2b27df60e96f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:59.102018 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-467bf3db-8568-459b-b7ce-2b27df60e96f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:59.102794 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-467bf3db-8568-459b-b7ce-2b27df60e96f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:59.103229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-467bf3db-8568-459b-b7ce-2b27df60e96f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:59.253337 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-467bf3db-8568-459b-b7ce-2b27df60e96f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:59.262047 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-467bf3db-8568-459b-b7ce-2b27df60e96f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:59.263552 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-467bf3db-8568-459b-b7ce-2b27df60e96f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:30:59.264776 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-467bf3db-8568-459b-b7ce-2b27df60e96f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.177690 Aug 04 10:30:59.265448 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 424/808] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:30:59 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:00.290999 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-74bf1ad5-6e63-4518-853b-eec1b1d5b207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:00.293586 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-74bf1ad5-6e63-4518-853b-eec1b1d5b207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:00.302067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-74bf1ad5-6e63-4518-853b-eec1b1d5b207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:00.302775 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-74bf1ad5-6e63-4518-853b-eec1b1d5b207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:00.304095 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-74bf1ad5-6e63-4518-853b-eec1b1d5b207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:00.305039 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-74bf1ad5-6e63-4518-853b-eec1b1d5b207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:00.469953 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-74bf1ad5-6e63-4518-853b-eec1b1d5b207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:00.478209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-74bf1ad5-6e63-4518-853b-eec1b1d5b207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:00.479703 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-74bf1ad5-6e63-4518-853b-eec1b1d5b207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:00.480874 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-74bf1ad5-6e63-4518-853b-eec1b1d5b207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.195406 Aug 04 10:31:00.481421 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 385/809] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:00 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:01.503308 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-50e58cc7-1b05-42b6-bf63-5596c753c64e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:01.503926 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-50e58cc7-1b05-42b6-bf63-5596c753c64e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:01.510423 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50e58cc7-1b05-42b6-bf63-5596c753c64e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:01.510878 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50e58cc7-1b05-42b6-bf63-5596c753c64e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:01.511614 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50e58cc7-1b05-42b6-bf63-5596c753c64e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:01.512071 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-50e58cc7-1b05-42b6-bf63-5596c753c64e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:01.671687 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-50e58cc7-1b05-42b6-bf63-5596c753c64e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:01.680613 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-50e58cc7-1b05-42b6-bf63-5596c753c64e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:01.682607 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-50e58cc7-1b05-42b6-bf63-5596c753c64e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:01.683757 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-50e58cc7-1b05-42b6-bf63-5596c753c64e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.184259 Aug 04 10:31:01.684431 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 425/810] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:01 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:02.708421 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1c62894f-74e4-49a6-b3d3-df005626089c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:02.708963 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-1c62894f-74e4-49a6-b3d3-df005626089c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:02.715489 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1c62894f-74e4-49a6-b3d3-df005626089c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:02.715933 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1c62894f-74e4-49a6-b3d3-df005626089c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:02.716723 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1c62894f-74e4-49a6-b3d3-df005626089c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:02.717155 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1c62894f-74e4-49a6-b3d3-df005626089c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:02.859220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-1c62894f-74e4-49a6-b3d3-df005626089c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:02.867029 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-1c62894f-74e4-49a6-b3d3-df005626089c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:02.869348 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-1c62894f-74e4-49a6-b3d3-df005626089c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:02.870498 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-1c62894f-74e4-49a6-b3d3-df005626089c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.166477 Aug 04 10:31:02.871056 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 386/811] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:02 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:03.894059 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-de769391-8716-465d-8698-aee2b2010582 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:03.894679 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-de769391-8716-465d-8698-aee2b2010582 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:03.902011 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de769391-8716-465d-8698-aee2b2010582 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:03.902464 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de769391-8716-465d-8698-aee2b2010582 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:03.903215 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de769391-8716-465d-8698-aee2b2010582 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:03.903644 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de769391-8716-465d-8698-aee2b2010582 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:04.182408 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-de769391-8716-465d-8698-aee2b2010582 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:04.190243 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-de769391-8716-465d-8698-aee2b2010582 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:04.191729 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-de769391-8716-465d-8698-aee2b2010582 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:04.192942 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-de769391-8716-465d-8698-aee2b2010582 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.303405 Aug 04 10:31:04.193457 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 426/812] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:03 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:05.216812 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f2c496e3-8784-4652-80f3-a0f77c5ffedd tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:05.217345 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f2c496e3-8784-4652-80f3-a0f77c5ffedd tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:05.223781 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f2c496e3-8784-4652-80f3-a0f77c5ffedd tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:05.224419 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f2c496e3-8784-4652-80f3-a0f77c5ffedd tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:05.225174 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f2c496e3-8784-4652-80f3-a0f77c5ffedd tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:05.225594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f2c496e3-8784-4652-80f3-a0f77c5ffedd tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:05.510397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f2c496e3-8784-4652-80f3-a0f77c5ffedd tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:05.518169 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f2c496e3-8784-4652-80f3-a0f77c5ffedd tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:05.519645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f2c496e3-8784-4652-80f3-a0f77c5ffedd tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:05.520975 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f2c496e3-8784-4652-80f3-a0f77c5ffedd tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.308767 Aug 04 10:31:05.521533 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 387/813] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:05 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:05.578669 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ef2947ba-9093-436b-878c-6fab4dcd512c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:05.579172 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ef2947ba-9093-436b-878c-6fab4dcd512c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:05.585639 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef2947ba-9093-436b-878c-6fab4dcd512c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:05.586074 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef2947ba-9093-436b-878c-6fab4dcd512c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:05.586832 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef2947ba-9093-436b-878c-6fab4dcd512c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:05.587290 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ef2947ba-9093-436b-878c-6fab4dcd512c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:05.624364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ef2947ba-9093-436b-878c-6fab4dcd512c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:31:05.669310 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:05.703675 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ef2947ba-9093-436b-878c-6fab4dcd512c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 204 len: 0 microversion: 2.1 time: 0.128907 Aug 04 10:31:05.704639 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 427/814] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:31:05 2022] DELETE /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:31:05.713557 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-cca7bb20-ca69-4b3a-8f57-ae172dc219f2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:05.714171 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-cca7bb20-ca69-4b3a-8f57-ae172dc219f2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:05.720593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cca7bb20-ca69-4b3a-8f57-ae172dc219f2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:05.721143 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cca7bb20-ca69-4b3a-8f57-ae172dc219f2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:05.721943 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cca7bb20-ca69-4b3a-8f57-ae172dc219f2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:05.722632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cca7bb20-ca69-4b3a-8f57-ae172dc219f2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:05.873551 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-cca7bb20-ca69-4b3a-8f57-ae172dc219f2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:05.881555 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-cca7bb20-ca69-4b3a-8f57-ae172dc219f2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1579 microversion: 2.1 time: 0.172774 Aug 04 10:31:05.882173 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 388/815] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:05 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1579 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:06.546950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bfa02d7c-081e-4327-9a87-2b720235b33d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:06.547788 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bfa02d7c-081e-4327-9a87-2b720235b33d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:06.555499 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bfa02d7c-081e-4327-9a87-2b720235b33d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:06.556994 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bfa02d7c-081e-4327-9a87-2b720235b33d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:06.557894 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bfa02d7c-081e-4327-9a87-2b720235b33d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:06.558326 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bfa02d7c-081e-4327-9a87-2b720235b33d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:06.692000 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bfa02d7c-081e-4327-9a87-2b720235b33d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:06.700277 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bfa02d7c-081e-4327-9a87-2b720235b33d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:06.702110 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bfa02d7c-081e-4327-9a87-2b720235b33d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:06.703259 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bfa02d7c-081e-4327-9a87-2b720235b33d tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.164068 Aug 04 10:31:06.703802 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 428/816] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:06 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:06.906480 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4b2da3fe-9679-4029-aa39-ec01c1dbc489 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:06.907075 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4b2da3fe-9679-4029-aa39-ec01c1dbc489 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:06.909510 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:06.914874 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b2da3fe-9679-4029-aa39-ec01c1dbc489 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:06.915936 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b2da3fe-9679-4029-aa39-ec01c1dbc489 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:06.916752 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b2da3fe-9679-4029-aa39-ec01c1dbc489 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:06.917193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4b2da3fe-9679-4029-aa39-ec01c1dbc489 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:07.055026 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4b2da3fe-9679-4029-aa39-ec01c1dbc489 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:07.062498 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4b2da3fe-9679-4029-aa39-ec01c1dbc489 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1579 microversion: 2.1 time: 0.159906 Aug 04 10:31:07.063057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 389/817] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:06 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:07.728724 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f12efabd-3b95-4b7f-8f9b-3885a255b393 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:07.729334 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f12efabd-3b95-4b7f-8f9b-3885a255b393 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:07.735869 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f12efabd-3b95-4b7f-8f9b-3885a255b393 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:07.736412 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f12efabd-3b95-4b7f-8f9b-3885a255b393 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:07.737115 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f12efabd-3b95-4b7f-8f9b-3885a255b393 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:07.737582 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f12efabd-3b95-4b7f-8f9b-3885a255b393 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:07.895471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f12efabd-3b95-4b7f-8f9b-3885a255b393 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:07.903943 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f12efabd-3b95-4b7f-8f9b-3885a255b393 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:07.905496 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f12efabd-3b95-4b7f-8f9b-3885a255b393 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:07.906731 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f12efabd-3b95-4b7f-8f9b-3885a255b393 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.182586 Aug 04 10:31:07.907340 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 429/818] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:07 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:08.085090 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5ebae69f-286c-4c8a-b1dd-f2bd92854b8b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:08.085934 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5ebae69f-286c-4c8a-b1dd-f2bd92854b8b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:08.094766 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5ebae69f-286c-4c8a-b1dd-f2bd92854b8b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:08.095588 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5ebae69f-286c-4c8a-b1dd-f2bd92854b8b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:08.096756 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5ebae69f-286c-4c8a-b1dd-f2bd92854b8b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:08.097254 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5ebae69f-286c-4c8a-b1dd-f2bd92854b8b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:08.164807 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5ebae69f-286c-4c8a-b1dd-f2bd92854b8b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:08.173013 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5ebae69f-286c-4c8a-b1dd-f2bd92854b8b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 200 len: 1511 microversion: 2.1 time: 0.092498 Aug 04 10:31:08.173572 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 390/819] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:08 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 1511 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:31:08.367797 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-b8975403-b605-4c3d-b988-2d0111df2e99 req-e23019bd-82b8-43e5-adca-376f6a21ae64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50c1eff-d3b4-4002-8596-abeba3280c3d", "name": "network-vif-deleted", "tag": "36ab2e93-5e76-4e77-8112-8f585e52b695"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:31:08.387450 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-b8975403-b605-4c3d-b988-2d0111df2e99 req-e23019bd-82b8-43e5-adca-376f6a21ae64 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:08.387912 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-b8975403-b605-4c3d-b988-2d0111df2e99 req-e23019bd-82b8-43e5-adca-376f6a21ae64 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:08.401784 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-b8975403-b605-4c3d-b988-2d0111df2e99 req-e23019bd-82b8-43e5-adca-376f6a21ae64 service nova] Creating event network-vif-deleted:36ab2e93-5e76-4e77-8112-8f585e52b695 for instance a50c1eff-d3b4-4002-8596-abeba3280c3d on hv-cinder-82660 Aug 04 10:31:08.408611 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-b8975403-b605-4c3d-b988-2d0111df2e99 req-e23019bd-82b8-43e5-adca-376f6a21ae64 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044535 Aug 04 10:31:08.409454 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 430/820] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:08.643119 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-074600cc-09ed-420a-95d8-86fd0a7f0ce9 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:08.643995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-074600cc-09ed-420a-95d8-86fd0a7f0ce9 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:08.650523 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-074600cc-09ed-420a-95d8-86fd0a7f0ce9 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:08.651179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-074600cc-09ed-420a-95d8-86fd0a7f0ce9 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:08.652335 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-074600cc-09ed-420a-95d8-86fd0a7f0ce9 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:08.652978 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-074600cc-09ed-420a-95d8-86fd0a7f0ce9 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:08.678568 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-074600cc-09ed-420a-95d8-86fd0a7f0ce9 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/ips" status: 200 len: 146 microversion: 2.1 time: 0.039460 Aug 04 10:31:08.679106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 391/821] 10.222.0.72 () {58 vars in 1248 bytes} [Thu Aug 4 10:31:08 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:08.934603 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-188d58d9-b827-424b-b5b5-310c43592b13 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:08.935499 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-188d58d9-b827-424b-b5b5-310c43592b13 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:08.947116 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-188d58d9-b827-424b-b5b5-310c43592b13 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:08.948708 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-188d58d9-b827-424b-b5b5-310c43592b13 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:08.951814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-188d58d9-b827-424b-b5b5-310c43592b13 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:08.953658 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-188d58d9-b827-424b-b5b5-310c43592b13 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:09.181781 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-188d58d9-b827-424b-b5b5-310c43592b13 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:09.192604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-188d58d9-b827-424b-b5b5-310c43592b13 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:09.194377 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-188d58d9-b827-424b-b5b5-310c43592b13 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:09.195678 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-188d58d9-b827-424b-b5b5-310c43592b13 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.266460 Aug 04 10:31:09.196473 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 431/822] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:08 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:09.202132 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1945fe14-e60f-4c58-a958-3c42bab0588f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:09.202872 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-1945fe14-e60f-4c58-a958-3c42bab0588f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:09.209477 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1945fe14-e60f-4c58-a958-3c42bab0588f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:09.210442 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1945fe14-e60f-4c58-a958-3c42bab0588f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:09.211901 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1945fe14-e60f-4c58-a958-3c42bab0588f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:09.213016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1945fe14-e60f-4c58-a958-3c42bab0588f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:09.226894 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-1945fe14-e60f-4c58-a958-3c42bab0588f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] HTTP exception thrown: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1945fe14-e60f-4c58-a958-3c42bab0588f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Request method failure captured: Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d HTTP/1.1 Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi6571Qo0RGqhq4s9W-WkwAkEjtkuK8tHZdJKzuu8AuB0j6Tt9SC6K6S1d9-Y-geGfwQn7MDx90I_79gahKzd0SKMa1ePLNvqJjG9wzd1e3sBa6MKoqtPnQqcndKuvPOnEzAq4pmGJpJcOI7jC9O09a9mTVPvXy04powahpVcWRUNcudc Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 82b077dd80c54b08ba3ad79b8cafd3f7 Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:31:09.229272 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:31:09.230931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:31:09.230931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:31:09.230931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 82b077dd80c54b08ba3ad79b8cafd3f7 Aug 04 10:31:09.230931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:31:09.230931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-TestVolumeBootPattern-1536160160-project Aug 04 10:31:09.230931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:31:09.230931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:31:09.230931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: fd829e78e710440687678701fea3cf2c Aug 04 10:31:09.230931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-TestVolumeBootPattern-1536160160-project Aug 04 10:31:09.230931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:31:09.230931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:31:09.230931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': 'a50c1eff-d3b4-4002-8596-abeba3280c3d'} Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:31:09.231865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:31:09.233420 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:31:09.235352 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1945fe14-e60f-4c58-a958-3c42bab0588f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Returning 404 to user: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:31:09.236316 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-1945fe14-e60f-4c58-a958-3c42bab0588f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 404 len: 111 microversion: 2.1 time: 0.039245 Aug 04 10:31:09.236781 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 392/823] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:09 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:31:09.341161 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-284603492", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-274711633", "security_groups": [{"name": "tempest-secgroup-smoke-1551120339"}], "block_device_mapping_v2": [{"uuid": "4fe6d17c-2840-490b-941f-c2305488e992", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3eadf84-c470-4284-bd83-89e428b31aa1"}]}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:31:09.456995 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] validate_networks() for [('a3eadf84-c470-4284-bd83-89e428b31aa1', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:31:09.948510 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:31:09.949076 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:31:09.949378 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:31:09.949778 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:31:09.950182 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:31:09.958908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:09.959346 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:09.960373 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:09.960816 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:09.977328 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Getting quotas for project 82b077dd80c54b08ba3ad79b8cafd3f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:31:09.981859 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Getting quotas for user fd829e78e710440687678701fea3cf2c and project 82b077dd80c54b08ba3ad79b8cafd3f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:31:10.041901 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:31:10.044095 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4fe6d17c-2840-490b-941f-c2305488e992',volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:31:10.044378 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-2d190d71-2dac-45f3-93de-64a239753df1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e07b475-2a4c-4e22-9050-d6f44ec54479"}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:31:10.046758 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-2d190d71-2dac-45f3-93de-64a239753df1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:10.052936 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2d190d71-2dac-45f3-93de-64a239753df1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:10.053376 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2d190d71-2dac-45f3-93de-64a239753df1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:10.054126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2d190d71-2dac-45f3-93de-64a239753df1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:10.054551 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2d190d71-2dac-45f3-93de-64a239753df1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:10.176458 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9fe2fd5b-7786-4650-b88d-d018e94dc0f5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.839458 Aug 04 10:31:10.183151 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 432/824] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:31:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:31:10.193688 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-06a387a5-1fc7-4ac8-aba5-6cddd51a7fb2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:10.194300 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-06a387a5-1fc7-4ac8-aba5-6cddd51a7fb2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:10.251255 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-06a387a5-1fc7-4ac8-aba5-6cddd51a7fb2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:10.258325 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-06a387a5-1fc7-4ac8-aba5-6cddd51a7fb2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1093 microversion: 2.1 time: 0.068346 Aug 04 10:31:10.259590 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 433/825] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:10 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:10.263767 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2dd06760-e2a5-400b-9c3b-49ee56c641a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:10.264393 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2dd06760-e2a5-400b-9c3b-49ee56c641a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:10.270613 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2dd06760-e2a5-400b-9c3b-49ee56c641a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:10.271406 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2dd06760-e2a5-400b-9c3b-49ee56c641a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:10.272073 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2dd06760-e2a5-400b-9c3b-49ee56c641a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:10.272510 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2dd06760-e2a5-400b-9c3b-49ee56c641a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:10.411307 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2dd06760-e2a5-400b-9c3b-49ee56c641a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:10.425547 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2dd06760-e2a5-400b-9c3b-49ee56c641a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:10.427342 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2dd06760-e2a5-400b-9c3b-49ee56c641a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:10.428537 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2dd06760-e2a5-400b-9c3b-49ee56c641a1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.168366 Aug 04 10:31:10.429130 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 434/826] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:10 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:11.278530 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a09d6314-da60-4697-9674-f8ec87326532 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:11.279169 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a09d6314-da60-4697-9674-f8ec87326532 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:11.285670 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a09d6314-da60-4697-9674-f8ec87326532 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:11.286115 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a09d6314-da60-4697-9674-f8ec87326532 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:11.286874 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a09d6314-da60-4697-9674-f8ec87326532 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:11.287303 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a09d6314-da60-4697-9674-f8ec87326532 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:11.347293 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a09d6314-da60-4697-9674-f8ec87326532 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:11.354645 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a09d6314-da60-4697-9674-f8ec87326532 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1143 microversion: 2.1 time: 0.079969 Aug 04 10:31:11.355198 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 435/827] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:11 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:31:11.451357 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-aa787528-29fa-48af-bb02-efaa08c5bd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:11.451883 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-aa787528-29fa-48af-bb02-efaa08c5bd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:11.457791 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aa787528-29fa-48af-bb02-efaa08c5bd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:11.458275 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aa787528-29fa-48af-bb02-efaa08c5bd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:11.458986 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aa787528-29fa-48af-bb02-efaa08c5bd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:11.459418 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aa787528-29fa-48af-bb02-efaa08c5bd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:11.583505 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-aa787528-29fa-48af-bb02-efaa08c5bd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:11.591675 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-aa787528-29fa-48af-bb02-efaa08c5bd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:11.593278 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-aa787528-29fa-48af-bb02-efaa08c5bd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:11.594428 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-aa787528-29fa-48af-bb02-efaa08c5bd97 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.146890 Aug 04 10:31:11.594982 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 436/828] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:11 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:31:12.375290 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-647653fb-fe07-47b2-be30-1695528c288d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:12.375933 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-647653fb-fe07-47b2-be30-1695528c288d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:12.382538 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-647653fb-fe07-47b2-be30-1695528c288d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:12.382987 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-647653fb-fe07-47b2-be30-1695528c288d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:12.383856 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-647653fb-fe07-47b2-be30-1695528c288d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:12.384307 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-647653fb-fe07-47b2-be30-1695528c288d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:12.460673 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-647653fb-fe07-47b2-be30-1695528c288d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:12.468478 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-647653fb-fe07-47b2-be30-1695528c288d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1135 microversion: 2.1 time: 0.096956 Aug 04 10:31:12.469045 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 437/829] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:12 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1135 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:31:12.535214 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-2d190d71-2dac-45f3-93de-64a239753df1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "POST /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.495064 Aug 04 10:31:12.535814 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 393/830] 10.222.0.72 () {60 vars in 1323 bytes} [Thu Aug 4 10:31:10 2022] POST /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments => generated 194 bytes in 2496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:31:12.617347 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f948bd30-0891-4853-a04c-03cbb6bc0b20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:12.617946 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f948bd30-0891-4853-a04c-03cbb6bc0b20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:12.624653 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f948bd30-0891-4853-a04c-03cbb6bc0b20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:12.625097 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f948bd30-0891-4853-a04c-03cbb6bc0b20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:12.625839 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f948bd30-0891-4853-a04c-03cbb6bc0b20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:12.626266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f948bd30-0891-4853-a04c-03cbb6bc0b20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:12.752705 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f948bd30-0891-4853-a04c-03cbb6bc0b20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:12.760743 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f948bd30-0891-4853-a04c-03cbb6bc0b20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:12.762257 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f948bd30-0891-4853-a04c-03cbb6bc0b20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:12.763411 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f948bd30-0891-4853-a04c-03cbb6bc0b20 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.149903 Aug 04 10:31:12.763988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 438/831] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:12 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:13.491623 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-89facdc1-7271-4273-8167-c08739d4de68 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:13.492349 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-89facdc1-7271-4273-8167-c08739d4de68 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:13.498638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-89facdc1-7271-4273-8167-c08739d4de68 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:13.499365 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-89facdc1-7271-4273-8167-c08739d4de68 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:13.500364 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-89facdc1-7271-4273-8167-c08739d4de68 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:13.500806 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-89facdc1-7271-4273-8167-c08739d4de68 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:13.565530 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-89facdc1-7271-4273-8167-c08739d4de68 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:13.575025 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-89facdc1-7271-4273-8167-c08739d4de68 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1209 microversion: 2.1 time: 0.087732 Aug 04 10:31:13.576267 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 394/832] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:13 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:13.787360 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4dbbe4a2-7a48-433d-8ca2-ce519c57128e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:13.787931 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4dbbe4a2-7a48-433d-8ca2-ce519c57128e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:13.794601 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4dbbe4a2-7a48-433d-8ca2-ce519c57128e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:13.795058 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4dbbe4a2-7a48-433d-8ca2-ce519c57128e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:13.795826 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4dbbe4a2-7a48-433d-8ca2-ce519c57128e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:13.796307 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4dbbe4a2-7a48-433d-8ca2-ce519c57128e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:13.941763 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4dbbe4a2-7a48-433d-8ca2-ce519c57128e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:13.950016 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4dbbe4a2-7a48-433d-8ca2-ce519c57128e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:13.951649 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4dbbe4a2-7a48-433d-8ca2-ce519c57128e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:13.953227 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4dbbe4a2-7a48-433d-8ca2-ce519c57128e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.170575 Aug 04 10:31:13.953928 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 439/833] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:13 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:14.596384 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-2db036d3-22f4-4dbb-8b55-c1a3b7922647 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:14.597165 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-2db036d3-22f4-4dbb-8b55-c1a3b7922647 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:14.603685 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2db036d3-22f4-4dbb-8b55-c1a3b7922647 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:14.604164 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2db036d3-22f4-4dbb-8b55-c1a3b7922647 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:14.605164 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2db036d3-22f4-4dbb-8b55-c1a3b7922647 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:14.605595 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2db036d3-22f4-4dbb-8b55-c1a3b7922647 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:14.623283 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:14.735212 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-56b34322-6080-4c1c-8c4b-bae8f91844af req-1d598d0f-df9b-45a2-a088-fe2a528f9d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73870ea-272e-4d63-adc0-0db553627ab6", "tag": "111adfd2-bc73-439c-9619-d4d37c3bfccd"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:31:14.749346 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-56b34322-6080-4c1c-8c4b-bae8f91844af req-1d598d0f-df9b-45a2-a088-fe2a528f9d0a service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:14.749790 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-56b34322-6080-4c1c-8c4b-bae8f91844af req-1d598d0f-df9b-45a2-a088-fe2a528f9d0a service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:14.763457 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-56b34322-6080-4c1c-8c4b-bae8f91844af req-1d598d0f-df9b-45a2-a088-fe2a528f9d0a service nova] Creating event network-changed:111adfd2-bc73-439c-9619-d4d37c3bfccd for instance c73870ea-272e-4d63-adc0-0db553627ab6 on hv-cinder-82660 Aug 04 10:31:14.769169 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-56b34322-6080-4c1c-8c4b-bae8f91844af req-1d598d0f-df9b-45a2-a088-fe2a528f9d0a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042217 Aug 04 10:31:14.770304 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 440/834] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:31:14.780278 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-2db036d3-22f4-4dbb-8b55-c1a3b7922647 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:14.789609 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-2db036d3-22f4-4dbb-8b55-c1a3b7922647 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1277 microversion: 2.1 time: 0.196802 Aug 04 10:31:14.790186 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 395/835] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:14 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:14.980933 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b69200bf-9bb8-42a7-98ed-486a8e1fc48a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:14.981628 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b69200bf-9bb8-42a7-98ed-486a8e1fc48a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:14.988656 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b69200bf-9bb8-42a7-98ed-486a8e1fc48a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:14.989107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b69200bf-9bb8-42a7-98ed-486a8e1fc48a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:14.989870 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b69200bf-9bb8-42a7-98ed-486a8e1fc48a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:14.990303 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b69200bf-9bb8-42a7-98ed-486a8e1fc48a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:15.136499 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b69200bf-9bb8-42a7-98ed-486a8e1fc48a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:15.145571 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b69200bf-9bb8-42a7-98ed-486a8e1fc48a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:15.147181 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b69200bf-9bb8-42a7-98ed-486a8e1fc48a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:15.148350 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b69200bf-9bb8-42a7-98ed-486a8e1fc48a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.173408 Aug 04 10:31:15.148898 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 441/836] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:14 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:31:15.811321 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5978e4b6-3255-47a2-89b2-a21cb53f5a20 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:15.812283 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5978e4b6-3255-47a2-89b2-a21cb53f5a20 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:15.819513 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5978e4b6-3255-47a2-89b2-a21cb53f5a20 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:15.820100 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5978e4b6-3255-47a2-89b2-a21cb53f5a20 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:15.821032 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5978e4b6-3255-47a2-89b2-a21cb53f5a20 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:15.821663 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5978e4b6-3255-47a2-89b2-a21cb53f5a20 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:15.988872 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5978e4b6-3255-47a2-89b2-a21cb53f5a20 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:15.999933 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5978e4b6-3255-47a2-89b2-a21cb53f5a20 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1277 microversion: 2.1 time: 0.193365 Aug 04 10:31:16.012562 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 396/837] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:15 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:16.172521 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-473bbf58-e882-431a-bb47-282aa6897240 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:16.173133 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-473bbf58-e882-431a-bb47-282aa6897240 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:16.180641 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-473bbf58-e882-431a-bb47-282aa6897240 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:16.181126 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-473bbf58-e882-431a-bb47-282aa6897240 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:16.182771 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-473bbf58-e882-431a-bb47-282aa6897240 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:16.183254 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-473bbf58-e882-431a-bb47-282aa6897240 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:16.319323 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-473bbf58-e882-431a-bb47-282aa6897240 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:16.327349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-473bbf58-e882-431a-bb47-282aa6897240 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:16.329755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-473bbf58-e882-431a-bb47-282aa6897240 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:16.330901 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-473bbf58-e882-431a-bb47-282aa6897240 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1746 microversion: 2.20 time: 0.163185 Aug 04 10:31:16.331577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 442/838] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:16 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:17.023610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c820ef3c-d5de-410c-b9bd-85724bc8868d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:17.024982 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c820ef3c-d5de-410c-b9bd-85724bc8868d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:17.032640 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c820ef3c-d5de-410c-b9bd-85724bc8868d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:17.033215 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c820ef3c-d5de-410c-b9bd-85724bc8868d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:17.034073 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c820ef3c-d5de-410c-b9bd-85724bc8868d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:17.034598 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c820ef3c-d5de-410c-b9bd-85724bc8868d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:17.208062 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c820ef3c-d5de-410c-b9bd-85724bc8868d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:17.222022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c820ef3c-d5de-410c-b9bd-85724bc8868d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1277 microversion: 2.1 time: 0.203082 Aug 04 10:31:17.228981 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 397/839] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:17 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:17.355225 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d5ff372a-6d02-437e-99e3-8f9bc3747c2b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:17.358428 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d5ff372a-6d02-437e-99e3-8f9bc3747c2b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:17.365629 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5ff372a-6d02-437e-99e3-8f9bc3747c2b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:17.366542 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5ff372a-6d02-437e-99e3-8f9bc3747c2b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:17.367360 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5ff372a-6d02-437e-99e3-8f9bc3747c2b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:17.367998 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d5ff372a-6d02-437e-99e3-8f9bc3747c2b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:17.540811 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d5ff372a-6d02-437e-99e3-8f9bc3747c2b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:17.548977 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d5ff372a-6d02-437e-99e3-8f9bc3747c2b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:17.551088 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d5ff372a-6d02-437e-99e3-8f9bc3747c2b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:17.552725 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d5ff372a-6d02-437e-99e3-8f9bc3747c2b tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1746 microversion: 2.20 time: 0.202127 Aug 04 10:31:17.553759 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 443/840] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:17 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1746 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:18.120383 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-aedced7b-667f-4517-ab6b-481a93ca08bf req-9d8587d8-caa1-4ec1-b937-69ecd19fc0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d953ca9-81b0-46f6-af0f-22e198ddb24b", "name": "network-vif-plugged", "status": "completed", "tag": "e506b457-5f08-48b5-9d0b-c71bdf4640ec"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:31:18.133159 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-aedced7b-667f-4517-ab6b-481a93ca08bf req-9d8587d8-caa1-4ec1-b937-69ecd19fc0a8 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:18.133854 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-aedced7b-667f-4517-ab6b-481a93ca08bf req-9d8587d8-caa1-4ec1-b937-69ecd19fc0a8 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:18.146516 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-aedced7b-667f-4517-ab6b-481a93ca08bf req-9d8587d8-caa1-4ec1-b937-69ecd19fc0a8 service nova] Creating event network-vif-plugged:e506b457-5f08-48b5-9d0b-c71bdf4640ec for instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b on hv-cinder-82660 Aug 04 10:31:18.152299 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-aedced7b-667f-4517-ab6b-481a93ca08bf req-9d8587d8-caa1-4ec1-b937-69ecd19fc0a8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.284401 Aug 04 10:31:18.153216 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 398/841] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:18.243151 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a0302a0b-54d4-4028-b563-e39914e3dc8c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:18.244662 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a0302a0b-54d4-4028-b563-e39914e3dc8c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:18.258070 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a0302a0b-54d4-4028-b563-e39914e3dc8c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:18.258530 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a0302a0b-54d4-4028-b563-e39914e3dc8c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:18.260236 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a0302a0b-54d4-4028-b563-e39914e3dc8c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:18.260691 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a0302a0b-54d4-4028-b563-e39914e3dc8c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:18.438646 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a0302a0b-54d4-4028-b563-e39914e3dc8c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:18.446684 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a0302a0b-54d4-4028-b563-e39914e3dc8c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1277 microversion: 2.1 time: 0.207685 Aug 04 10:31:18.460197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 444/842] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:18 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:18.576452 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dd180016-c5e8-4ce1-be55-c311ae8819b1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:18.577341 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dd180016-c5e8-4ce1-be55-c311ae8819b1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:18.584361 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dd180016-c5e8-4ce1-be55-c311ae8819b1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:18.585077 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dd180016-c5e8-4ce1-be55-c311ae8819b1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:18.586028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dd180016-c5e8-4ce1-be55-c311ae8819b1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:18.586971 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dd180016-c5e8-4ce1-be55-c311ae8819b1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:18.751216 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-dd180016-c5e8-4ce1-be55-c311ae8819b1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:18.761085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-dd180016-c5e8-4ce1-be55-c311ae8819b1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:18.762625 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-dd180016-c5e8-4ce1-be55-c311ae8819b1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:18.763833 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-dd180016-c5e8-4ce1-be55-c311ae8819b1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1741 microversion: 2.20 time: 0.192395 Aug 04 10:31:18.764793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 399/843] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:18 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:19.474001 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c6786b83-3f1f-46ff-be05-8dc22832ef77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:19.475685 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c6786b83-3f1f-46ff-be05-8dc22832ef77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:19.480609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:19.485961 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c6786b83-3f1f-46ff-be05-8dc22832ef77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:19.486629 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c6786b83-3f1f-46ff-be05-8dc22832ef77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:19.487571 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c6786b83-3f1f-46ff-be05-8dc22832ef77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:19.488041 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c6786b83-3f1f-46ff-be05-8dc22832ef77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:19.663333 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c6786b83-3f1f-46ff-be05-8dc22832ef77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:19.671861 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c6786b83-3f1f-46ff-be05-8dc22832ef77 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1277 microversion: 2.1 time: 0.205297 Aug 04 10:31:19.672471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 445/844] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:19 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:19.791326 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-654bf429-eb9a-421b-a006-e8a75251d3aa tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:19.791941 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-654bf429-eb9a-421b-a006-e8a75251d3aa tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:19.798790 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-654bf429-eb9a-421b-a006-e8a75251d3aa tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:19.799282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-654bf429-eb9a-421b-a006-e8a75251d3aa tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:19.800127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-654bf429-eb9a-421b-a006-e8a75251d3aa tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:19.800759 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-654bf429-eb9a-421b-a006-e8a75251d3aa tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:19.963620 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-654bf429-eb9a-421b-a006-e8a75251d3aa tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:19.972516 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-654bf429-eb9a-421b-a006-e8a75251d3aa tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:19.974028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-654bf429-eb9a-421b-a006-e8a75251d3aa tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:19.975192 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-654bf429-eb9a-421b-a006-e8a75251d3aa tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1741 microversion: 2.20 time: 0.188065 Aug 04 10:31:19.976117 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 400/845] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:19 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:20.230112 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7fb4cf7e-649b-4422-8da7-9bd8ea0cad2c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:20.232284 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7fb4cf7e-649b-4422-8da7-9bd8ea0cad2c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:20.234149 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:20.249536 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7fb4cf7e-649b-4422-8da7-9bd8ea0cad2c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:20.250840 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7fb4cf7e-649b-4422-8da7-9bd8ea0cad2c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:20.251788 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7fb4cf7e-649b-4422-8da7-9bd8ea0cad2c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:20.252595 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7fb4cf7e-649b-4422-8da7-9bd8ea0cad2c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:20.261894 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=8 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:20.291926 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7fb4cf7e-649b-4422-8da7-9bd8ea0cad2c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065824 Aug 04 10:31:20.293488 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 446/846] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:31:20 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:20.304994 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ae2ced6f-e98a-425f-961d-91454fa67999 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:20.305756 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ae2ced6f-e98a-425f-961d-91454fa67999 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:20.314873 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ae2ced6f-e98a-425f-961d-91454fa67999 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:20.315492 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ae2ced6f-e98a-425f-961d-91454fa67999 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:20.316452 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ae2ced6f-e98a-425f-961d-91454fa67999 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:20.316984 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ae2ced6f-e98a-425f-961d-91454fa67999 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:20.362408 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ae2ced6f-e98a-425f-961d-91454fa67999 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments/9e07b475-2a4c-4e22-9050-d6f44ec54479" status: 200 len: 194 microversion: 2.1 time: 0.062391 Aug 04 10:31:20.363534 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 401/847] 10.222.0.72 () {58 vars in 1413 bytes} [Thu Aug 4 10:31:20 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments/9e07b475-2a4c-4e22-9050-d6f44ec54479 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:20.695724 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b30c13a3-bbbd-46bc-949b-a92978d641a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:20.696364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b30c13a3-bbbd-46bc-949b-a92978d641a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:20.705266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b30c13a3-bbbd-46bc-949b-a92978d641a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:20.706036 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b30c13a3-bbbd-46bc-949b-a92978d641a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:20.707184 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b30c13a3-bbbd-46bc-949b-a92978d641a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:20.707615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b30c13a3-bbbd-46bc-949b-a92978d641a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:20.710538 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:20.878336 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b30c13a3-bbbd-46bc-949b-a92978d641a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:20.887694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b30c13a3-bbbd-46bc-949b-a92978d641a8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1265 microversion: 2.1 time: 0.196937 Aug 04 10:31:20.888548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 447/848] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:20 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:31:21.002022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b57d138b-b966-4319-843b-83dd8e2186f7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:21.002667 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b57d138b-b966-4319-843b-83dd8e2186f7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:21.010000 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b57d138b-b966-4319-843b-83dd8e2186f7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:21.010439 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b57d138b-b966-4319-843b-83dd8e2186f7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:21.011232 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b57d138b-b966-4319-843b-83dd8e2186f7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:21.011670 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b57d138b-b966-4319-843b-83dd8e2186f7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:21.162175 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b57d138b-b966-4319-843b-83dd8e2186f7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:21.171084 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b57d138b-b966-4319-843b-83dd8e2186f7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:21.172647 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b57d138b-b966-4319-843b-83dd8e2186f7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:21.174041 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b57d138b-b966-4319-843b-83dd8e2186f7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1741 microversion: 2.20 time: 0.176054 Aug 04 10:31:21.174583 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 402/849] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:20 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:21.911829 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6045f545-830b-4149-9906-a727c5ca0237 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:21.913292 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6045f545-830b-4149-9906-a727c5ca0237 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:21.920880 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6045f545-830b-4149-9906-a727c5ca0237 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:21.921632 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6045f545-830b-4149-9906-a727c5ca0237 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:21.922405 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6045f545-830b-4149-9906-a727c5ca0237 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:21.922840 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6045f545-830b-4149-9906-a727c5ca0237 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:22.067696 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6045f545-830b-4149-9906-a727c5ca0237 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:22.075461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6045f545-830b-4149-9906-a727c5ca0237 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1265 microversion: 2.1 time: 0.167673 Aug 04 10:31:22.076043 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 448/850] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:21 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:31:22.197450 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-99be28b3-2350-400b-a2a7-9389e24ab448 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:22.198726 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-99be28b3-2350-400b-a2a7-9389e24ab448 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:22.205472 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-99be28b3-2350-400b-a2a7-9389e24ab448 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:22.205992 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-99be28b3-2350-400b-a2a7-9389e24ab448 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:22.206781 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-99be28b3-2350-400b-a2a7-9389e24ab448 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:22.207234 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-99be28b3-2350-400b-a2a7-9389e24ab448 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:22.345605 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-99be28b3-2350-400b-a2a7-9389e24ab448 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:22.354249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-99be28b3-2350-400b-a2a7-9389e24ab448 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:22.355821 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-99be28b3-2350-400b-a2a7-9389e24ab448 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:22.357241 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-99be28b3-2350-400b-a2a7-9389e24ab448 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1741 microversion: 2.20 time: 0.164056 Aug 04 10:31:22.358012 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 403/851] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:22 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:23.097550 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c10e1692-f767-4b56-972c-bc83033d03b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:23.098770 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c10e1692-f767-4b56-972c-bc83033d03b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:23.106292 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c10e1692-f767-4b56-972c-bc83033d03b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:23.106753 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c10e1692-f767-4b56-972c-bc83033d03b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:23.107533 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c10e1692-f767-4b56-972c-bc83033d03b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:23.108013 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c10e1692-f767-4b56-972c-bc83033d03b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:23.246186 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c10e1692-f767-4b56-972c-bc83033d03b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:23.254216 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c10e1692-f767-4b56-972c-bc83033d03b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1265 microversion: 2.1 time: 0.161437 Aug 04 10:31:23.267476 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 449/852] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:23 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:23.381017 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c0b9ec5b-d5fc-47f8-bca8-d42df567ee0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:23.382275 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c0b9ec5b-d5fc-47f8-bca8-d42df567ee0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:23.389515 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c0b9ec5b-d5fc-47f8-bca8-d42df567ee0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:23.390163 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c0b9ec5b-d5fc-47f8-bca8-d42df567ee0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:23.391089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c0b9ec5b-d5fc-47f8-bca8-d42df567ee0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:23.391706 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c0b9ec5b-d5fc-47f8-bca8-d42df567ee0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:23.548016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c0b9ec5b-d5fc-47f8-bca8-d42df567ee0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:23.567525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c0b9ec5b-d5fc-47f8-bca8-d42df567ee0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:23.569477 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c0b9ec5b-d5fc-47f8-bca8-d42df567ee0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:23.573340 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c0b9ec5b-d5fc-47f8-bca8-d42df567ee0e tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1741 microversion: 2.20 time: 0.196347 Aug 04 10:31:23.573989 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 404/853] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:23 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:23.904775 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-dbd1e3c1-f9da-407a-9211-cad2bbb4dec2 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5728032-9abb-4aaa-9c56-8935ebcb713a"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:31:23.907161 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-dbd1e3c1-f9da-407a-9211-cad2bbb4dec2 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:23.913425 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dbd1e3c1-f9da-407a-9211-cad2bbb4dec2 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:23.913874 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dbd1e3c1-f9da-407a-9211-cad2bbb4dec2 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:23.914803 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dbd1e3c1-f9da-407a-9211-cad2bbb4dec2 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:23.915440 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dbd1e3c1-f9da-407a-9211-cad2bbb4dec2 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:24.181903 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-dbd1e3c1-f9da-407a-9211-cad2bbb4dec2 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "POST /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281161 Aug 04 10:31:24.182753 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 450/854] 10.222.0.72 () {60 vars in 1323 bytes} [Thu Aug 4 10:31:23 2022] POST /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:31:24.275975 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-493b33f7-6f15-4ab6-a9e5-bd6681e66d74 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:24.276735 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-493b33f7-6f15-4ab6-a9e5-bd6681e66d74 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:24.283552 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-493b33f7-6f15-4ab6-a9e5-bd6681e66d74 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:24.284079 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-493b33f7-6f15-4ab6-a9e5-bd6681e66d74 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:24.285216 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-493b33f7-6f15-4ab6-a9e5-bd6681e66d74 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:24.285801 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-493b33f7-6f15-4ab6-a9e5-bd6681e66d74 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:24.436343 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-493b33f7-6f15-4ab6-a9e5-bd6681e66d74 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:24.445102 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-493b33f7-6f15-4ab6-a9e5-bd6681e66d74 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1265 microversion: 2.1 time: 0.174184 Aug 04 10:31:24.447986 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 405/855] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:24 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:24.598878 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b9186be6-2931-4d1a-98ce-8b9bf0cb57f8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:24.600072 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b9186be6-2931-4d1a-98ce-8b9bf0cb57f8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:24.608168 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9186be6-2931-4d1a-98ce-8b9bf0cb57f8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:24.608853 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9186be6-2931-4d1a-98ce-8b9bf0cb57f8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:24.610309 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9186be6-2931-4d1a-98ce-8b9bf0cb57f8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:24.610948 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b9186be6-2931-4d1a-98ce-8b9bf0cb57f8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:24.778373 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b9186be6-2931-4d1a-98ce-8b9bf0cb57f8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:24.787618 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b9186be6-2931-4d1a-98ce-8b9bf0cb57f8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:24.789229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b9186be6-2931-4d1a-98ce-8b9bf0cb57f8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:24.790469 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b9186be6-2931-4d1a-98ce-8b9bf0cb57f8 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1741 microversion: 2.20 time: 0.196966 Aug 04 10:31:24.791083 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 451/856] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:24 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:25.465926 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4a375075-23c6-4c77-9bae-29f51e184137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:25.467110 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4a375075-23c6-4c77-9bae-29f51e184137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:25.474736 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4a375075-23c6-4c77-9bae-29f51e184137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:25.475303 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4a375075-23c6-4c77-9bae-29f51e184137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:25.476168 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4a375075-23c6-4c77-9bae-29f51e184137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:25.476670 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4a375075-23c6-4c77-9bae-29f51e184137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:25.629513 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4a375075-23c6-4c77-9bae-29f51e184137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:25.643079 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4a375075-23c6-4c77-9bae-29f51e184137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1265 microversion: 2.1 time: 0.181553 Aug 04 10:31:25.643682 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 406/857] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:25 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:25.813917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b76d8992-3f5e-4aaa-b26d-0fea5c9365cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:25.814515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b76d8992-3f5e-4aaa-b26d-0fea5c9365cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:25.821724 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b76d8992-3f5e-4aaa-b26d-0fea5c9365cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:25.822322 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b76d8992-3f5e-4aaa-b26d-0fea5c9365cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:25.823098 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b76d8992-3f5e-4aaa-b26d-0fea5c9365cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:25.823532 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b76d8992-3f5e-4aaa-b26d-0fea5c9365cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:25.968842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b76d8992-3f5e-4aaa-b26d-0fea5c9365cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:25.978897 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b76d8992-3f5e-4aaa-b26d-0fea5c9365cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:25.980682 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b76d8992-3f5e-4aaa-b26d-0fea5c9365cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:25.982101 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b76d8992-3f5e-4aaa-b26d-0fea5c9365cb tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1741 microversion: 2.20 time: 0.172204 Aug 04 10:31:25.996192 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 452/858] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:25 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:26.663177 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c1964aed-a88f-46f7-999f-5fac0057c811 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:26.664789 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c1964aed-a88f-46f7-999f-5fac0057c811 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:26.672966 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c1964aed-a88f-46f7-999f-5fac0057c811 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:26.673719 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c1964aed-a88f-46f7-999f-5fac0057c811 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:26.675003 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c1964aed-a88f-46f7-999f-5fac0057c811 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:26.675666 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c1964aed-a88f-46f7-999f-5fac0057c811 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:26.855484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c1964aed-a88f-46f7-999f-5fac0057c811 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:26.863450 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c1964aed-a88f-46f7-999f-5fac0057c811 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1265 microversion: 2.1 time: 0.204402 Aug 04 10:31:26.864035 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 407/859] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:26 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:27.006488 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a1419cc1-5fea-454b-81fe-e09e742c92e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:27.007990 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a1419cc1-5fea-454b-81fe-e09e742c92e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:27.015731 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a1419cc1-5fea-454b-81fe-e09e742c92e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:27.016352 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a1419cc1-5fea-454b-81fe-e09e742c92e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:27.017273 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a1419cc1-5fea-454b-81fe-e09e742c92e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:27.017813 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a1419cc1-5fea-454b-81fe-e09e742c92e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:27.159847 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a1419cc1-5fea-454b-81fe-e09e742c92e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:27.168777 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a1419cc1-5fea-454b-81fe-e09e742c92e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:27.170463 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a1419cc1-5fea-454b-81fe-e09e742c92e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:27.171745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a1419cc1-5fea-454b-81fe-e09e742c92e2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1741 microversion: 2.20 time: 0.169556 Aug 04 10:31:27.172430 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 453/860] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:27 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:27.888777 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c3f62be8-4b7d-497f-9e64-c76e9ad95e32 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:27.889694 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c3f62be8-4b7d-497f-9e64-c76e9ad95e32 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:27.906468 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c3f62be8-4b7d-497f-9e64-c76e9ad95e32 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:27.907315 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c3f62be8-4b7d-497f-9e64-c76e9ad95e32 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:27.908499 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c3f62be8-4b7d-497f-9e64-c76e9ad95e32 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:27.909033 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c3f62be8-4b7d-497f-9e64-c76e9ad95e32 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:28.053884 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c3f62be8-4b7d-497f-9e64-c76e9ad95e32 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:28.067473 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c3f62be8-4b7d-497f-9e64-c76e9ad95e32 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1265 microversion: 2.1 time: 0.184163 Aug 04 10:31:28.068382 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 408/861] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:27 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:28.195186 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-beaa6985-e4bd-4c18-b7ec-b1e1e0f8b1ed tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:28.195707 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-beaa6985-e4bd-4c18-b7ec-b1e1e0f8b1ed tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:28.202264 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-beaa6985-e4bd-4c18-b7ec-b1e1e0f8b1ed tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:28.202716 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-beaa6985-e4bd-4c18-b7ec-b1e1e0f8b1ed tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:28.203491 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-beaa6985-e4bd-4c18-b7ec-b1e1e0f8b1ed tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:28.203931 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-beaa6985-e4bd-4c18-b7ec-b1e1e0f8b1ed tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:28.352381 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-beaa6985-e4bd-4c18-b7ec-b1e1e0f8b1ed tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:28.363011 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-beaa6985-e4bd-4c18-b7ec-b1e1e0f8b1ed tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:28.364375 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-beaa6985-e4bd-4c18-b7ec-b1e1e0f8b1ed tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:28.365638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-beaa6985-e4bd-4c18-b7ec-b1e1e0f8b1ed tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1723 microversion: 2.20 time: 0.174531 Aug 04 10:31:28.366639 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 454/862] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:28 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:29.089690 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a8f1cafa-e533-47d1-be40-4af5da05bf18 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:29.090242 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a8f1cafa-e533-47d1-be40-4af5da05bf18 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:29.096855 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a8f1cafa-e533-47d1-be40-4af5da05bf18 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:29.097304 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a8f1cafa-e533-47d1-be40-4af5da05bf18 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:29.098070 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a8f1cafa-e533-47d1-be40-4af5da05bf18 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:29.098504 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a8f1cafa-e533-47d1-be40-4af5da05bf18 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:29.234831 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a8f1cafa-e533-47d1-be40-4af5da05bf18 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:29.242683 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a8f1cafa-e533-47d1-be40-4af5da05bf18 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1265 microversion: 2.1 time: 0.157567 Aug 04 10:31:29.243564 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 409/863] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:29 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:29.389942 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-08459cd3-7223-4cc9-900f-3c2745d41c0c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:29.390548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-08459cd3-7223-4cc9-900f-3c2745d41c0c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:29.397589 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-08459cd3-7223-4cc9-900f-3c2745d41c0c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:29.398036 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-08459cd3-7223-4cc9-900f-3c2745d41c0c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:29.398808 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-08459cd3-7223-4cc9-900f-3c2745d41c0c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:29.399237 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-08459cd3-7223-4cc9-900f-3c2745d41c0c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:29.530786 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-08459cd3-7223-4cc9-900f-3c2745d41c0c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:29.538752 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-08459cd3-7223-4cc9-900f-3c2745d41c0c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:29.540296 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-08459cd3-7223-4cc9-900f-3c2745d41c0c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:29.541553 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-08459cd3-7223-4cc9-900f-3c2745d41c0c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1723 microversion: 2.20 time: 0.155492 Aug 04 10:31:29.542264 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 455/864] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:29 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:31:29.907609 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-b1d0bc1c-01d6-4445-b713-5513610997e4 req-f8e7d445-597a-4304-abb5-59f81c548557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73870ea-272e-4d63-adc0-0db553627ab6", "name": "network-vif-plugged", "status": "completed", "tag": "111adfd2-bc73-439c-9619-d4d37c3bfccd"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:31:29.919208 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-b1d0bc1c-01d6-4445-b713-5513610997e4 req-f8e7d445-597a-4304-abb5-59f81c548557 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:29.919654 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-b1d0bc1c-01d6-4445-b713-5513610997e4 req-f8e7d445-597a-4304-abb5-59f81c548557 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:29.942322 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-b1d0bc1c-01d6-4445-b713-5513610997e4 req-f8e7d445-597a-4304-abb5-59f81c548557 service nova] Creating event network-vif-plugged:111adfd2-bc73-439c-9619-d4d37c3bfccd for instance c73870ea-272e-4d63-adc0-0db553627ab6 on hv-cinder-82660 Aug 04 10:31:29.947487 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-b1d0bc1c-01d6-4445-b713-5513610997e4 req-f8e7d445-597a-4304-abb5-59f81c548557 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044581 Aug 04 10:31:29.948440 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 410/865] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:30.264181 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d2da2009-20f6-4741-9fae-dfb6965fd009 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:30.264855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d2da2009-20f6-4741-9fae-dfb6965fd009 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:30.271384 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2da2009-20f6-4741-9fae-dfb6965fd009 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:30.271859 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2da2009-20f6-4741-9fae-dfb6965fd009 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:30.272638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2da2009-20f6-4741-9fae-dfb6965fd009 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:30.273064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d2da2009-20f6-4741-9fae-dfb6965fd009 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:30.414057 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d2da2009-20f6-4741-9fae-dfb6965fd009 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:30.423402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d2da2009-20f6-4741-9fae-dfb6965fd009 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1265 microversion: 2.1 time: 0.163602 Aug 04 10:31:30.423981 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 456/866] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:30 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:30.565290 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9929b8c4-7d7b-45f0-bf2f-34a43b3b32a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:30.565961 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9929b8c4-7d7b-45f0-bf2f-34a43b3b32a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:30.572590 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9929b8c4-7d7b-45f0-bf2f-34a43b3b32a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:30.573043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9929b8c4-7d7b-45f0-bf2f-34a43b3b32a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:30.573771 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9929b8c4-7d7b-45f0-bf2f-34a43b3b32a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:30.574198 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9929b8c4-7d7b-45f0-bf2f-34a43b3b32a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:30.706831 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9929b8c4-7d7b-45f0-bf2f-34a43b3b32a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:30.715233 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9929b8c4-7d7b-45f0-bf2f-34a43b3b32a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:30.716773 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9929b8c4-7d7b-45f0-bf2f-34a43b3b32a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:30.717919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9929b8c4-7d7b-45f0-bf2f-34a43b3b32a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1723 microversion: 2.20 time: 0.156835 Aug 04 10:31:30.718518 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 411/867] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:30 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:31.266713 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cc05341f-1c2a-4bec-b5a0-4cd13fded7e0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:31.267202 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-cc05341f-1c2a-4bec-b5a0-4cd13fded7e0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:31.273361 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cc05341f-1c2a-4bec-b5a0-4cd13fded7e0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:31.273806 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cc05341f-1c2a-4bec-b5a0-4cd13fded7e0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:31.274557 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cc05341f-1c2a-4bec-b5a0-4cd13fded7e0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:31.275587 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cc05341f-1c2a-4bec-b5a0-4cd13fded7e0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:31.298067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-cc05341f-1c2a-4bec-b5a0-4cd13fded7e0 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/ips" status: 200 len: 148 microversion: 2.1 time: 0.035210 Aug 04 10:31:31.298628 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 457/868] 10.222.0.72 () {58 vars in 1248 bytes} [Thu Aug 4 10:31:31 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/ips => generated 148 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:31.445509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-db8ce7a2-94d8-4fde-90c3-1916781ef653 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:31.446144 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-db8ce7a2-94d8-4fde-90c3-1916781ef653 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:31.453137 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-db8ce7a2-94d8-4fde-90c3-1916781ef653 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:31.453586 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-db8ce7a2-94d8-4fde-90c3-1916781ef653 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:31.454346 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-db8ce7a2-94d8-4fde-90c3-1916781ef653 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:31.454786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-db8ce7a2-94d8-4fde-90c3-1916781ef653 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:31.607590 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-db8ce7a2-94d8-4fde-90c3-1916781ef653 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:31.615102 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-db8ce7a2-94d8-4fde-90c3-1916781ef653 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1265 microversion: 2.1 time: 0.173849 Aug 04 10:31:31.616330 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 412/869] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:31 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:31.741483 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e494cc7a-8cc8-4e1c-b39f-644231c845d4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:31.742091 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e494cc7a-8cc8-4e1c-b39f-644231c845d4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:31.748673 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e494cc7a-8cc8-4e1c-b39f-644231c845d4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:31.749124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e494cc7a-8cc8-4e1c-b39f-644231c845d4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:31.749999 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e494cc7a-8cc8-4e1c-b39f-644231c845d4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:31.750375 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e494cc7a-8cc8-4e1c-b39f-644231c845d4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:31.888857 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e494cc7a-8cc8-4e1c-b39f-644231c845d4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:31.897655 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e494cc7a-8cc8-4e1c-b39f-644231c845d4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:31.899844 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e494cc7a-8cc8-4e1c-b39f-644231c845d4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:31.901552 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e494cc7a-8cc8-4e1c-b39f-644231c845d4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1726 microversion: 2.20 time: 0.164282 Aug 04 10:31:31.902302 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 458/870] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:31 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:31.927599 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f1189980-4c3c-4a5a-91f0-3ff0ac78fd54 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b4d713b-ad2b-49a4-869f-ebde2bf8f56b"}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:31:31.944097 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f1189980-4c3c-4a5a-91f0-3ff0ac78fd54 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:31.964674 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f1189980-4c3c-4a5a-91f0-3ff0ac78fd54 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:31.965823 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f1189980-4c3c-4a5a-91f0-3ff0ac78fd54 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:31.967125 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f1189980-4c3c-4a5a-91f0-3ff0ac78fd54 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:31.967721 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f1189980-4c3c-4a5a-91f0-3ff0ac78fd54 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:31.973569 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-3b6ed6bb-0e18-4861-bafd-9f190899ef6d req-d3f3b5a4-568e-46fe-a4db-22535102ce01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d953ca9-81b0-46f6-af0f-22e198ddb24b", "name": "network-vif-unplugged", "status": "completed", "tag": "e506b457-5f08-48b5-9d0b-c71bdf4640ec"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:31:31.996421 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-3b6ed6bb-0e18-4861-bafd-9f190899ef6d req-d3f3b5a4-568e-46fe-a4db-22535102ce01 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:31.996972 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-3b6ed6bb-0e18-4861-bafd-9f190899ef6d req-d3f3b5a4-568e-46fe-a4db-22535102ce01 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:32.013782 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=100 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:32.020249 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-3b6ed6bb-0e18-4861-bafd-9f190899ef6d req-d3f3b5a4-568e-46fe-a4db-22535102ce01 service nova] Creating event network-vif-unplugged:e506b457-5f08-48b5-9d0b-c71bdf4640ec for instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b on hv-cinder-82660 Aug 04 10:31:32.027598 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-3b6ed6bb-0e18-4861-bafd-9f190899ef6d req-d3f3b5a4-568e-46fe-a4db-22535102ce01 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057956 Aug 04 10:31:32.028930 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 459/871] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:32.321102 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f1189980-4c3c-4a5a-91f0-3ff0ac78fd54 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "POST /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.398172 Aug 04 10:31:32.321713 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 413/872] 10.222.0.72 () {62 vars in 1364 bytes} [Thu Aug 4 10:31:31 2022] POST /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b/os-volume_attachments => generated 188 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:31:32.449269 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-57784afb-6287-4317-b334-d14fb621f11a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:32.449804 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-57784afb-6287-4317-b334-d14fb621f11a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:32.456504 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-57784afb-6287-4317-b334-d14fb621f11a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:32.457025 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-57784afb-6287-4317-b334-d14fb621f11a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:32.457905 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-57784afb-6287-4317-b334-d14fb621f11a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:32.458408 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-57784afb-6287-4317-b334-d14fb621f11a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:32.639359 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-46aaed39-0d8f-4db8-82d5-22088d83b36c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:32.640554 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-46aaed39-0d8f-4db8-82d5-22088d83b36c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:32.650447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-46aaed39-0d8f-4db8-82d5-22088d83b36c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:32.651016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-46aaed39-0d8f-4db8-82d5-22088d83b36c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:32.651861 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-46aaed39-0d8f-4db8-82d5-22088d83b36c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:32.652332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-46aaed39-0d8f-4db8-82d5-22088d83b36c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:32.686268 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:32.692685 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-57784afb-6287-4317-b334-d14fb621f11a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "DELETE /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b/os-volume_attachments/0b4d713b-ad2b-49a4-869f-ebde2bf8f56b" status: 202 len: 0 microversion: 2.20 time: 0.248547 Aug 04 10:31:32.693289 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 460/873] 10.222.0.72 () {60 vars in 1457 bytes} [Thu Aug 4 10:31:32 2022] DELETE /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b/os-volume_attachments/0b4d713b-ad2b-49a4-869f-ebde2bf8f56b => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:31:32.698883 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ce53c519-b031-4e11-85da-889ca752c874 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc2f5baa-70ac-403b-ae13-c7295ba0e20e"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:31:32.701295 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ce53c519-b031-4e11-85da-889ca752c874 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:32.710425 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce53c519-b031-4e11-85da-889ca752c874 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:32.711376 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce53c519-b031-4e11-85da-889ca752c874 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:32.713044 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce53c519-b031-4e11-85da-889ca752c874 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:32.713689 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ce53c519-b031-4e11-85da-889ca752c874 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:32.802960 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-46aaed39-0d8f-4db8-82d5-22088d83b36c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:32.817529 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-46aaed39-0d8f-4db8-82d5-22088d83b36c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1265 microversion: 2.1 time: 0.184447 Aug 04 10:31:32.818489 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 414/874] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:32 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:31:32.823580 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-597895dd-9de8-4613-ade8-fe9d31e61a6c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:31:32.824215 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-597895dd-9de8-4613-ade8-fe9d31e61a6c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:32.838437 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-597895dd-9de8-4613-ade8-fe9d31e61a6c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:32.838893 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-597895dd-9de8-4613-ade8-fe9d31e61a6c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:32.839676 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-597895dd-9de8-4613-ade8-fe9d31e61a6c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:32.840145 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-597895dd-9de8-4613-ade8-fe9d31e61a6c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:32.887546 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-597895dd-9de8-4613-ade8-fe9d31e61a6c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117667) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 10:31:32.956509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-597895dd-9de8-4613-ade8-fe9d31e61a6c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "POST /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b/action" status: 202 len: 0 microversion: 2.20 time: 0.136594 Aug 04 10:31:32.957380 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 415/875] 10.222.0.72 () {62 vars in 1319 bytes} [Thu Aug 4 10:31:32 2022] POST /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:31:32.965980 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0a239063-5afc-4312-b3b4-2768276ab13d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:32.968220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0a239063-5afc-4312-b3b4-2768276ab13d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:32.974958 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0a239063-5afc-4312-b3b4-2768276ab13d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:32.975647 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0a239063-5afc-4312-b3b4-2768276ab13d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:32.976650 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0a239063-5afc-4312-b3b4-2768276ab13d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:32.977250 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0a239063-5afc-4312-b3b4-2768276ab13d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:33.010552 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0a239063-5afc-4312-b3b4-2768276ab13d tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048786 Aug 04 10:31:33.011666 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 416/876] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:31:32 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:33.021119 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1d34d632-81ae-48a1-b5ad-b5e2116accbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:33.021809 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-1d34d632-81ae-48a1-b5ad-b5e2116accbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:33.036320 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1d34d632-81ae-48a1-b5ad-b5e2116accbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:33.036786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1d34d632-81ae-48a1-b5ad-b5e2116accbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:33.037624 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1d34d632-81ae-48a1-b5ad-b5e2116accbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:33.038032 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1d34d632-81ae-48a1-b5ad-b5e2116accbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:33.038232 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ce53c519-b031-4e11-85da-889ca752c874 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "POST /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343316 Aug 04 10:31:33.039001 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 461/877] 10.222.0.72 () {60 vars in 1323 bytes} [Thu Aug 4 10:31:32 2022] POST /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:33.157087 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f0c52a81-379c-4019-83ef-afbeb8944c63 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:33.157671 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f0c52a81-379c-4019-83ef-afbeb8944c63 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:33.164003 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f0c52a81-379c-4019-83ef-afbeb8944c63 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:33.164474 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f0c52a81-379c-4019-83ef-afbeb8944c63 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:33.165266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f0c52a81-379c-4019-83ef-afbeb8944c63 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:33.166270 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f0c52a81-379c-4019-83ef-afbeb8944c63 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:33.196688 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f0c52a81-379c-4019-83ef-afbeb8944c63 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments/9e07b475-2a4c-4e22-9050-d6f44ec54479" status: 200 len: 194 microversion: 2.1 time: 0.044435 Aug 04 10:31:33.197353 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 462/878] 10.222.0.72 () {58 vars in 1413 bytes} [Thu Aug 4 10:31:33 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments/9e07b475-2a4c-4e22-9050-d6f44ec54479 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:31:33.207316 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-033ff666-7dd2-4d7e-a518-cb2f594973db tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:33.207785 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-033ff666-7dd2-4d7e-a518-cb2f594973db tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:33.213825 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-033ff666-7dd2-4d7e-a518-cb2f594973db tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:33.214501 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-033ff666-7dd2-4d7e-a518-cb2f594973db tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:33.215449 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-033ff666-7dd2-4d7e-a518-cb2f594973db tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:33.216105 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-033ff666-7dd2-4d7e-a518-cb2f594973db tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:33.255558 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-1d34d632-81ae-48a1-b5ad-b5e2116accbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:33.265306 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-1d34d632-81ae-48a1-b5ad-b5e2116accbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:33.267064 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-1d34d632-81ae-48a1-b5ad-b5e2116accbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:33.268328 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-1d34d632-81ae-48a1-b5ad-b5e2116accbe tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1674 microversion: 2.20 time: 0.251404 Aug 04 10:31:33.268890 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 417/879] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:33 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1674 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:33.307596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-033ff666-7dd2-4d7e-a518-cb2f594973db tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lazy-loading 'services' on Instance uuid 7f07bbd9-4e21-48ad-8ab9-fe9af12060be {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:31:33.379391 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-033ff666-7dd2-4d7e-a518-cb2f594973db tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments/9e07b475-2a4c-4e22-9050-d6f44ec54479" status: 202 len: 0 microversion: 2.1 time: 0.175621 Aug 04 10:31:33.380040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 463/880] 10.222.0.72 () {58 vars in 1416 bytes} [Thu Aug 4 10:31:33 2022] DELETE /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments/9e07b475-2a4c-4e22-9050-d6f44ec54479 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 10:31:33.840246 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6969a213-0c97-4992-a240-ff9ace99be0d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:33.841614 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6969a213-0c97-4992-a240-ff9ace99be0d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:33.848774 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6969a213-0c97-4992-a240-ff9ace99be0d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:33.849189 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6969a213-0c97-4992-a240-ff9ace99be0d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:33.849995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6969a213-0c97-4992-a240-ff9ace99be0d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:33.850423 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6969a213-0c97-4992-a240-ff9ace99be0d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:34.007984 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6969a213-0c97-4992-a240-ff9ace99be0d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:34.016122 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6969a213-0c97-4992-a240-ff9ace99be0d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1453 microversion: 2.1 time: 0.179889 Aug 04 10:31:34.016695 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 418/881] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:33 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:34.038067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ae50a33b-bd22-408e-b33a-27fc2783773f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:34.038705 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ae50a33b-bd22-408e-b33a-27fc2783773f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:34.045099 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ae50a33b-bd22-408e-b33a-27fc2783773f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:34.045548 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ae50a33b-bd22-408e-b33a-27fc2783773f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:34.046321 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ae50a33b-bd22-408e-b33a-27fc2783773f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:34.046759 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ae50a33b-bd22-408e-b33a-27fc2783773f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:34.182958 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ae50a33b-bd22-408e-b33a-27fc2783773f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:34.190795 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ae50a33b-bd22-408e-b33a-27fc2783773f tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1453 microversion: 2.1 time: 0.157441 Aug 04 10:31:34.191359 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 464/882] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:34 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:34.290978 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-15aad0ec-2e23-4956-a2cf-2ab5b51f2e99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:34.291638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-15aad0ec-2e23-4956-a2cf-2ab5b51f2e99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:34.299696 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-15aad0ec-2e23-4956-a2cf-2ab5b51f2e99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:34.300216 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-15aad0ec-2e23-4956-a2cf-2ab5b51f2e99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:34.301098 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-15aad0ec-2e23-4956-a2cf-2ab5b51f2e99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:34.301892 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-15aad0ec-2e23-4956-a2cf-2ab5b51f2e99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:34.569169 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-15aad0ec-2e23-4956-a2cf-2ab5b51f2e99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:34.577793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-15aad0ec-2e23-4956-a2cf-2ab5b51f2e99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:34.579784 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-15aad0ec-2e23-4956-a2cf-2ab5b51f2e99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:34.581043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-15aad0ec-2e23-4956-a2cf-2ab5b51f2e99 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.294123 Aug 04 10:31:34.596477 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 419/883] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:34 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:35.606653 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-370a9e43-a911-4d98-9b96-dab120e97da4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:35.607897 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-370a9e43-a911-4d98-9b96-dab120e97da4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:35.614958 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-370a9e43-a911-4d98-9b96-dab120e97da4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:35.615748 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-370a9e43-a911-4d98-9b96-dab120e97da4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:35.616905 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-370a9e43-a911-4d98-9b96-dab120e97da4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:35.617572 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-370a9e43-a911-4d98-9b96-dab120e97da4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:35.926205 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-370a9e43-a911-4d98-9b96-dab120e97da4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:35.937167 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-370a9e43-a911-4d98-9b96-dab120e97da4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:35.938651 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-370a9e43-a911-4d98-9b96-dab120e97da4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:35.939805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-370a9e43-a911-4d98-9b96-dab120e97da4 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.337503 Aug 04 10:31:35.940393 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 465/884] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:35 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:36.880712 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-8b1078f6-f32e-4b4e-8ddf-b1d5374dc493 req-549a3849-d5a5-4510-ac56-a9d45b9a75a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73870ea-272e-4d63-adc0-0db553627ab6", "tag": "111adfd2-bc73-439c-9619-d4d37c3bfccd"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:31:36.890932 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-8b1078f6-f32e-4b4e-8ddf-b1d5374dc493 req-549a3849-d5a5-4510-ac56-a9d45b9a75a5 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:36.891616 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-8b1078f6-f32e-4b4e-8ddf-b1d5374dc493 req-549a3849-d5a5-4510-ac56-a9d45b9a75a5 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:36.904746 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-8b1078f6-f32e-4b4e-8ddf-b1d5374dc493 req-549a3849-d5a5-4510-ac56-a9d45b9a75a5 service nova] Creating event network-changed:111adfd2-bc73-439c-9619-d4d37c3bfccd for instance c73870ea-272e-4d63-adc0-0db553627ab6 on hv-cinder-82660 Aug 04 10:31:36.910239 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-8b1078f6-f32e-4b4e-8ddf-b1d5374dc493 req-549a3849-d5a5-4510-ac56-a9d45b9a75a5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213610 Aug 04 10:31:36.911478 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 420/885] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:36.969716 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6b89cf5a-50b7-493c-955f-2ad549561c46 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:36.971041 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6b89cf5a-50b7-493c-955f-2ad549561c46 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:36.979077 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6b89cf5a-50b7-493c-955f-2ad549561c46 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:36.979785 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6b89cf5a-50b7-493c-955f-2ad549561c46 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:36.980924 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6b89cf5a-50b7-493c-955f-2ad549561c46 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:36.981571 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6b89cf5a-50b7-493c-955f-2ad549561c46 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:37.258101 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6b89cf5a-50b7-493c-955f-2ad549561c46 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:37.268302 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6b89cf5a-50b7-493c-955f-2ad549561c46 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:37.270395 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6b89cf5a-50b7-493c-955f-2ad549561c46 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:37.271783 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6b89cf5a-50b7-493c-955f-2ad549561c46 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.313118 Aug 04 10:31:37.273583 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 466/886] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:36 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:38.295852 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0bf47123-dc1a-43ba-a8e6-7113ee639fb1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:38.297207 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0bf47123-dc1a-43ba-a8e6-7113ee639fb1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:38.299876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:38.323994 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0bf47123-dc1a-43ba-a8e6-7113ee639fb1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:38.324571 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0bf47123-dc1a-43ba-a8e6-7113ee639fb1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:38.326806 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0bf47123-dc1a-43ba-a8e6-7113ee639fb1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:38.327251 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0bf47123-dc1a-43ba-a8e6-7113ee639fb1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:38.641871 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0bf47123-dc1a-43ba-a8e6-7113ee639fb1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:38.651815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0bf47123-dc1a-43ba-a8e6-7113ee639fb1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:38.653840 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0bf47123-dc1a-43ba-a8e6-7113ee639fb1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:38.655268 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0bf47123-dc1a-43ba-a8e6-7113ee639fb1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.364266 Aug 04 10:31:38.668222 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 421/887] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:38 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:39.680339 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8ebe3790-84d8-40b7-8687-6cc61d498f03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:39.681167 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8ebe3790-84d8-40b7-8687-6cc61d498f03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:39.688830 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8ebe3790-84d8-40b7-8687-6cc61d498f03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:39.689404 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8ebe3790-84d8-40b7-8687-6cc61d498f03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:39.690272 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8ebe3790-84d8-40b7-8687-6cc61d498f03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:39.690799 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8ebe3790-84d8-40b7-8687-6cc61d498f03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:39.905705 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8ebe3790-84d8-40b7-8687-6cc61d498f03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:39.916709 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8ebe3790-84d8-40b7-8687-6cc61d498f03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:39.919105 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8ebe3790-84d8-40b7-8687-6cc61d498f03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:39.921028 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8ebe3790-84d8-40b7-8687-6cc61d498f03 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.245831 Aug 04 10:31:39.922444 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 467/888] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:39 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:40.944842 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-251e6e79-427d-4a81-b257-7e255484aae7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:40.945602 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-251e6e79-427d-4a81-b257-7e255484aae7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:40.953109 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-251e6e79-427d-4a81-b257-7e255484aae7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:40.953805 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-251e6e79-427d-4a81-b257-7e255484aae7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:40.957622 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-251e6e79-427d-4a81-b257-7e255484aae7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:40.957622 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-251e6e79-427d-4a81-b257-7e255484aae7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:41.104636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-251e6e79-427d-4a81-b257-7e255484aae7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:41.114785 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-251e6e79-427d-4a81-b257-7e255484aae7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:41.117160 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-251e6e79-427d-4a81-b257-7e255484aae7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:41.119436 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-251e6e79-427d-4a81-b257-7e255484aae7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.178061 Aug 04 10:31:41.120503 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 422/889] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:40 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:42.144774 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7075bc17-235a-4d66-8cba-8a672ef17e86 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:42.145525 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7075bc17-235a-4d66-8cba-8a672ef17e86 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:42.154588 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7075bc17-235a-4d66-8cba-8a672ef17e86 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:42.155107 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7075bc17-235a-4d66-8cba-8a672ef17e86 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:42.156087 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7075bc17-235a-4d66-8cba-8a672ef17e86 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:42.156496 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7075bc17-235a-4d66-8cba-8a672ef17e86 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:42.302077 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7075bc17-235a-4d66-8cba-8a672ef17e86 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:42.311006 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7075bc17-235a-4d66-8cba-8a672ef17e86 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:42.312706 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-7075bc17-235a-4d66-8cba-8a672ef17e86 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:42.314010 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7075bc17-235a-4d66-8cba-8a672ef17e86 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.174090 Aug 04 10:31:42.314711 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 468/890] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:42 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:31:43.338967 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8290c9ff-7182-4bfc-847a-1c3c2a035b19 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:43.339571 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8290c9ff-7182-4bfc-847a-1c3c2a035b19 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:43.346543 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8290c9ff-7182-4bfc-847a-1c3c2a035b19 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:43.346993 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8290c9ff-7182-4bfc-847a-1c3c2a035b19 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:43.347789 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8290c9ff-7182-4bfc-847a-1c3c2a035b19 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:43.348251 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8290c9ff-7182-4bfc-847a-1c3c2a035b19 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:43.480056 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8290c9ff-7182-4bfc-847a-1c3c2a035b19 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:43.488126 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8290c9ff-7182-4bfc-847a-1c3c2a035b19 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:43.489618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8290c9ff-7182-4bfc-847a-1c3c2a035b19 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:43.490766 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8290c9ff-7182-4bfc-847a-1c3c2a035b19 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.156451 Aug 04 10:31:43.491316 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 423/891] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:43 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:44.513670 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4e895c9b-27e1-4310-a8a4-c483e0d21dc2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:44.514275 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4e895c9b-27e1-4310-a8a4-c483e0d21dc2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:44.520923 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4e895c9b-27e1-4310-a8a4-c483e0d21dc2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:44.521374 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4e895c9b-27e1-4310-a8a4-c483e0d21dc2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:44.522132 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4e895c9b-27e1-4310-a8a4-c483e0d21dc2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:44.522563 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4e895c9b-27e1-4310-a8a4-c483e0d21dc2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:44.649510 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4e895c9b-27e1-4310-a8a4-c483e0d21dc2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:44.658023 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4e895c9b-27e1-4310-a8a4-c483e0d21dc2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:44.659506 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4e895c9b-27e1-4310-a8a4-c483e0d21dc2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:44.660671 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4e895c9b-27e1-4310-a8a4-c483e0d21dc2 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.150982 Aug 04 10:31:44.661383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 469/892] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:44 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:45.683619 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5ba66d49-853d-45a6-aeeb-e1a6758ac924 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:45.684252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5ba66d49-853d-45a6-aeeb-e1a6758ac924 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:45.691314 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5ba66d49-853d-45a6-aeeb-e1a6758ac924 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:45.691773 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5ba66d49-853d-45a6-aeeb-e1a6758ac924 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:45.692594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5ba66d49-853d-45a6-aeeb-e1a6758ac924 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:45.693119 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5ba66d49-853d-45a6-aeeb-e1a6758ac924 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:45.835825 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5ba66d49-853d-45a6-aeeb-e1a6758ac924 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:45.844772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5ba66d49-853d-45a6-aeeb-e1a6758ac924 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:45.846412 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5ba66d49-853d-45a6-aeeb-e1a6758ac924 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:45.847573 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5ba66d49-853d-45a6-aeeb-e1a6758ac924 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.168525 Aug 04 10:31:45.848171 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 424/893] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:45 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:46.871692 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6403d181-1a7f-4f22-886f-279c6f5b72df tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:46.872333 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6403d181-1a7f-4f22-886f-279c6f5b72df tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:46.878786 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6403d181-1a7f-4f22-886f-279c6f5b72df tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:46.879232 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6403d181-1a7f-4f22-886f-279c6f5b72df tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:46.880010 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6403d181-1a7f-4f22-886f-279c6f5b72df tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:46.880448 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6403d181-1a7f-4f22-886f-279c6f5b72df tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:47.006814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6403d181-1a7f-4f22-886f-279c6f5b72df tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:47.015357 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6403d181-1a7f-4f22-886f-279c6f5b72df tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:47.016891 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-6403d181-1a7f-4f22-886f-279c6f5b72df tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:47.018040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6403d181-1a7f-4f22-886f-279c6f5b72df tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.150396 Aug 04 10:31:47.018600 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 470/894] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:46 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:48.049452 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-54808c8f-1fa0-48bc-9cea-0d75ee822a34 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:48.050002 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-54808c8f-1fa0-48bc-9cea-0d75ee822a34 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:48.057550 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-54808c8f-1fa0-48bc-9cea-0d75ee822a34 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:48.058007 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-54808c8f-1fa0-48bc-9cea-0d75ee822a34 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:48.058803 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-54808c8f-1fa0-48bc-9cea-0d75ee822a34 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:48.059238 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-54808c8f-1fa0-48bc-9cea-0d75ee822a34 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:48.204296 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-54808c8f-1fa0-48bc-9cea-0d75ee822a34 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:48.212406 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-54808c8f-1fa0-48bc-9cea-0d75ee822a34 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:48.213925 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-54808c8f-1fa0-48bc-9cea-0d75ee822a34 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:48.215620 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-54808c8f-1fa0-48bc-9cea-0d75ee822a34 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.176108 Aug 04 10:31:48.216492 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 425/895] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:48 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:49.239355 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ee4fa26c-5ae5-4acf-bbf4-1a7c4df25f78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:49.239996 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ee4fa26c-5ae5-4acf-bbf4-1a7c4df25f78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:49.246586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee4fa26c-5ae5-4acf-bbf4-1a7c4df25f78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:49.247044 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee4fa26c-5ae5-4acf-bbf4-1a7c4df25f78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:49.247808 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee4fa26c-5ae5-4acf-bbf4-1a7c4df25f78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:49.248266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ee4fa26c-5ae5-4acf-bbf4-1a7c4df25f78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:49.375863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ee4fa26c-5ae5-4acf-bbf4-1a7c4df25f78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:49.385297 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ee4fa26c-5ae5-4acf-bbf4-1a7c4df25f78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:49.386800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ee4fa26c-5ae5-4acf-bbf4-1a7c4df25f78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:49.388539 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ee4fa26c-5ae5-4acf-bbf4-1a7c4df25f78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.153087 Aug 04 10:31:49.389099 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 471/896] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:49 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:50.396586 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-2a157aab-8f86-4f4f-a555-9d4872916877 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:50.397740 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-2a157aab-8f86-4f4f-a555-9d4872916877 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:50.405278 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2a157aab-8f86-4f4f-a555-9d4872916877 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:50.405718 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2a157aab-8f86-4f4f-a555-9d4872916877 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:50.406492 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2a157aab-8f86-4f4f-a555-9d4872916877 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:50.406922 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2a157aab-8f86-4f4f-a555-9d4872916877 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:50.413547 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ac8069f4-574f-4fea-a8bb-c4bcccf3fe78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:50.414757 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ac8069f4-574f-4fea-a8bb-c4bcccf3fe78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:50.418363 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=54 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:50.422402 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ac8069f4-574f-4fea-a8bb-c4bcccf3fe78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:50.422851 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ac8069f4-574f-4fea-a8bb-c4bcccf3fe78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:50.423622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ac8069f4-574f-4fea-a8bb-c4bcccf3fe78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:50.424256 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ac8069f4-574f-4fea-a8bb-c4bcccf3fe78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:50.493422 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-2a157aab-8f86-4f4f-a555-9d4872916877 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lazy-loading 'services' on Instance uuid b55a1e93-26e7-4c91-bf51-5505f979d59b {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:31:50.496867 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:50.569364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ac8069f4-574f-4fea-a8bb-c4bcccf3fe78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:50.579221 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ac8069f4-574f-4fea-a8bb-c4bcccf3fe78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:50.581178 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ac8069f4-574f-4fea-a8bb-c4bcccf3fe78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:50.583137 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ac8069f4-574f-4fea-a8bb-c4bcccf3fe78 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.173160 Aug 04 10:31:50.597975 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 472/897] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:50 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:50.611766 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-2a157aab-8f86-4f4f-a555-9d4872916877 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-volume_attachments/fc2f5baa-70ac-403b-ae13-c7295ba0e20e" status: 202 len: 0 microversion: 2.1 time: 0.218923 Aug 04 10:31:50.612715 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 426/898] 10.222.0.72 () {58 vars in 1416 bytes} [Thu Aug 4 10:31:50 2022] DELETE /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-volume_attachments/fc2f5baa-70ac-403b-ae13-c7295ba0e20e => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:31:50.621917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b84fe0e7-e13c-45ff-9c0c-cd0776fad77c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:50.624840 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b84fe0e7-e13c-45ff-9c0c-cd0776fad77c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:50.634407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b84fe0e7-e13c-45ff-9c0c-cd0776fad77c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:50.634954 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b84fe0e7-e13c-45ff-9c0c-cd0776fad77c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:50.636984 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b84fe0e7-e13c-45ff-9c0c-cd0776fad77c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:50.638003 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b84fe0e7-e13c-45ff-9c0c-cd0776fad77c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:50.693893 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-da08f62c-600f-4c1b-bc94-f77f5ddb2e04 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:50.695085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-da08f62c-600f-4c1b-bc94-f77f5ddb2e04 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:50.701623 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b84fe0e7-e13c-45ff-9c0c-cd0776fad77c tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084274 Aug 04 10:31:50.702544 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 473/899] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:31:50 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:50.704284 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-da08f62c-600f-4c1b-bc94-f77f5ddb2e04 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:50.704998 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-da08f62c-600f-4c1b-bc94-f77f5ddb2e04 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:50.706621 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-da08f62c-600f-4c1b-bc94-f77f5ddb2e04 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:50.707389 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-da08f62c-600f-4c1b-bc94-f77f5ddb2e04 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:50.744236 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-da08f62c-600f-4c1b-bc94-f77f5ddb2e04 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments/b5728032-9abb-4aaa-9c56-8935ebcb713a" status: 200 len: 194 microversion: 2.1 time: 0.055125 Aug 04 10:31:50.745394 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 427/900] 10.222.0.72 () {58 vars in 1413 bytes} [Thu Aug 4 10:31:50 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments/b5728032-9abb-4aaa-9c56-8935ebcb713a => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:50.757099 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bf4cacfb-9fb9-420b-bb5f-c660d7d6c01e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:50.757820 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bf4cacfb-9fb9-420b-bb5f-c660d7d6c01e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:50.772825 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf4cacfb-9fb9-420b-bb5f-c660d7d6c01e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:50.773791 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf4cacfb-9fb9-420b-bb5f-c660d7d6c01e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:50.774622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf4cacfb-9fb9-420b-bb5f-c660d7d6c01e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:50.775064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf4cacfb-9fb9-420b-bb5f-c660d7d6c01e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:50.819724 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-f21b8ab1-4cad-4d9b-80bb-cbb3e35cf068 req-549960a9-d519-413c-8b74-66bee90593eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d953ca9-81b0-46f6-af0f-22e198ddb24b", "name": "network-vif-plugged", "status": "completed", "tag": "e506b457-5f08-48b5-9d0b-c71bdf4640ec"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:31:50.830127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-f21b8ab1-4cad-4d9b-80bb-cbb3e35cf068 req-549960a9-d519-413c-8b74-66bee90593eb service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:50.830582 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-f21b8ab1-4cad-4d9b-80bb-cbb3e35cf068 req-549960a9-d519-413c-8b74-66bee90593eb service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:50.844458 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-f21b8ab1-4cad-4d9b-80bb-cbb3e35cf068 req-549960a9-d519-413c-8b74-66bee90593eb service nova] Creating event network-vif-plugged:e506b457-5f08-48b5-9d0b-c71bdf4640ec for instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b on hv-cinder-82660 Aug 04 10:31:50.849223 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-f21b8ab1-4cad-4d9b-80bb-cbb3e35cf068 req-549960a9-d519-413c-8b74-66bee90593eb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033209 Aug 04 10:31:50.850171 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 428/901] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:31:50.869360 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-bf4cacfb-9fb9-420b-bb5f-c660d7d6c01e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lazy-loading 'services' on Instance uuid 7f07bbd9-4e21-48ad-8ab9-fe9af12060be {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:31:50.930889 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:50.942940 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bf4cacfb-9fb9-420b-bb5f-c660d7d6c01e tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments/b5728032-9abb-4aaa-9c56-8935ebcb713a" status: 202 len: 0 microversion: 2.1 time: 0.190163 Aug 04 10:31:50.943520 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 474/902] 10.222.0.72 () {58 vars in 1416 bytes} [Thu Aug 4 10:31:50 2022] DELETE /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments/b5728032-9abb-4aaa-9c56-8935ebcb713a => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:31:51.610887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-305f27a7-8d0c-426a-ae86-6aa3e73ef4e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:51.611666 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-305f27a7-8d0c-426a-ae86-6aa3e73ef4e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:51.617764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-305f27a7-8d0c-426a-ae86-6aa3e73ef4e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:51.618201 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-305f27a7-8d0c-426a-ae86-6aa3e73ef4e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:51.618949 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-305f27a7-8d0c-426a-ae86-6aa3e73ef4e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:51.619373 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-305f27a7-8d0c-426a-ae86-6aa3e73ef4e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:51.715146 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9a73515c-2153-47e5-bc01-9c0959976f23 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:51.718801 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9a73515c-2153-47e5-bc01-9c0959976f23 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:51.727169 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9a73515c-2153-47e5-bc01-9c0959976f23 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:51.727619 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9a73515c-2153-47e5-bc01-9c0959976f23 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:51.728703 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9a73515c-2153-47e5-bc01-9c0959976f23 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:51.729312 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9a73515c-2153-47e5-bc01-9c0959976f23 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:51.763149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-305f27a7-8d0c-426a-ae86-6aa3e73ef4e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:51.763742 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9a73515c-2153-47e5-bc01-9c0959976f23 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053035 Aug 04 10:31:51.764364 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 475/903] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:31:51 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:31:51.772547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-305f27a7-8d0c-426a-ae86-6aa3e73ef4e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:51.774060 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-305f27a7-8d0c-426a-ae86-6aa3e73ef4e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:51.775264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-305f27a7-8d0c-426a-ae86-6aa3e73ef4e7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.169645 Aug 04 10:31:51.776089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 429/904] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:51 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:52.776159 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-33fce0ca-db9a-4847-b334-98e140c9f651 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:52.778341 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-33fce0ca-db9a-4847-b334-98e140c9f651 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:52.785243 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33fce0ca-db9a-4847-b334-98e140c9f651 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:52.785998 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33fce0ca-db9a-4847-b334-98e140c9f651 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:52.786798 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33fce0ca-db9a-4847-b334-98e140c9f651 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:52.787302 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-33fce0ca-db9a-4847-b334-98e140c9f651 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:52.798994 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dff61f1d-341f-4d00-8288-80a668389c5c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:52.799597 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dff61f1d-341f-4d00-8288-80a668389c5c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:52.806276 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dff61f1d-341f-4d00-8288-80a668389c5c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:52.806722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dff61f1d-341f-4d00-8288-80a668389c5c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:52.807481 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dff61f1d-341f-4d00-8288-80a668389c5c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:52.807914 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dff61f1d-341f-4d00-8288-80a668389c5c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:52.819275 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-33fce0ca-db9a-4847-b334-98e140c9f651 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047137 Aug 04 10:31:52.819860 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 476/905] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:31:52 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:52.936985 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-dff61f1d-341f-4d00-8288-80a668389c5c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:52.944817 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-dff61f1d-341f-4d00-8288-80a668389c5c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:52.946325 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-dff61f1d-341f-4d00-8288-80a668389c5c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:52.947477 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-dff61f1d-341f-4d00-8288-80a668389c5c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.152374 Aug 04 10:31:52.948051 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 430/906] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:52 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:31:53.831380 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-25af9127-39ed-49fb-b70f-fdf9dbc7ffa9 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:53.833554 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-25af9127-39ed-49fb-b70f-fdf9dbc7ffa9 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:53.840702 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-25af9127-39ed-49fb-b70f-fdf9dbc7ffa9 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:53.841912 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-25af9127-39ed-49fb-b70f-fdf9dbc7ffa9 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:53.842597 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-25af9127-39ed-49fb-b70f-fdf9dbc7ffa9 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:53.843036 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-25af9127-39ed-49fb-b70f-fdf9dbc7ffa9 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:53.874032 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-25af9127-39ed-49fb-b70f-fdf9dbc7ffa9 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046693 Aug 04 10:31:53.879310 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 477/907] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:31:53 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:53.969645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-94033887-fa02-4430-b0c4-56fd2a5fb2e0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:53.970243 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-94033887-fa02-4430-b0c4-56fd2a5fb2e0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:53.976528 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-94033887-fa02-4430-b0c4-56fd2a5fb2e0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:53.976970 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-94033887-fa02-4430-b0c4-56fd2a5fb2e0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:53.977714 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-94033887-fa02-4430-b0c4-56fd2a5fb2e0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:53.978135 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-94033887-fa02-4430-b0c4-56fd2a5fb2e0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:54.136687 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-94033887-fa02-4430-b0c4-56fd2a5fb2e0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:54.146635 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-94033887-fa02-4430-b0c4-56fd2a5fb2e0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:54.148431 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-94033887-fa02-4430-b0c4-56fd2a5fb2e0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:54.149710 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-94033887-fa02-4430-b0c4-56fd2a5fb2e0 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.183874 Aug 04 10:31:54.150305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 431/908] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:53 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:54.885929 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-37ddf285-1637-409f-9ef4-20e1fdb81270 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:54.888691 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-37ddf285-1637-409f-9ef4-20e1fdb81270 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:54.895328 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37ddf285-1637-409f-9ef4-20e1fdb81270 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:54.895783 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37ddf285-1637-409f-9ef4-20e1fdb81270 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:54.896592 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37ddf285-1637-409f-9ef4-20e1fdb81270 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:54.897025 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-37ddf285-1637-409f-9ef4-20e1fdb81270 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:54.924963 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-37ddf285-1637-409f-9ef4-20e1fdb81270 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043023 Aug 04 10:31:54.925545 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 478/909] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:31:54 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:31:54.989043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dee8f9e0-de03-4b40-a2bb-4d79cbfb76cb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:54.989521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dee8f9e0-de03-4b40-a2bb-4d79cbfb76cb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:54.996065 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dee8f9e0-de03-4b40-a2bb-4d79cbfb76cb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:54.996507 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dee8f9e0-de03-4b40-a2bb-4d79cbfb76cb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:54.997270 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dee8f9e0-de03-4b40-a2bb-4d79cbfb76cb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:54.998243 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dee8f9e0-de03-4b40-a2bb-4d79cbfb76cb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:55.024046 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dee8f9e0-de03-4b40-a2bb-4d79cbfb76cb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Going to try to terminate instance {{(pid=117667) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:31:55.103018 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-dee8f9e0-de03-4b40-a2bb-4d79cbfb76cb tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 204 len: 0 microversion: 2.1 time: 0.117662 Aug 04 10:31:55.103589 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 432/910] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:31:54 2022] DELETE /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:31:55.112235 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-455aa954-bf53-4784-8f93-e0b3aeb8995e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:55.112844 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-455aa954-bf53-4784-8f93-e0b3aeb8995e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:55.122986 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-455aa954-bf53-4784-8f93-e0b3aeb8995e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:55.123445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-455aa954-bf53-4784-8f93-e0b3aeb8995e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:55.124250 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-455aa954-bf53-4784-8f93-e0b3aeb8995e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:55.124681 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-455aa954-bf53-4784-8f93-e0b3aeb8995e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:55.173533 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0f07deb2-5781-4d3d-abf2-34051f7d3dd7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:55.174220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0f07deb2-5781-4d3d-abf2-34051f7d3dd7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:55.187045 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0f07deb2-5781-4d3d-abf2-34051f7d3dd7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:55.188866 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0f07deb2-5781-4d3d-abf2-34051f7d3dd7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:55.190636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0f07deb2-5781-4d3d-abf2-34051f7d3dd7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:55.191271 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0f07deb2-5781-4d3d-abf2-34051f7d3dd7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:55.343727 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-455aa954-bf53-4784-8f93-e0b3aeb8995e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:55.351722 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-455aa954-bf53-4784-8f93-e0b3aeb8995e tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1677 microversion: 2.1 time: 0.243349 Aug 04 10:31:55.352400 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 479/911] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:55 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1677 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:31:55.378946 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0f07deb2-5781-4d3d-abf2-34051f7d3dd7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:55.387484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0f07deb2-5781-4d3d-abf2-34051f7d3dd7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:55.389134 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0f07deb2-5781-4d3d-abf2-34051f7d3dd7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:55.390289 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0f07deb2-5781-4d3d-abf2-34051f7d3dd7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.221558 Aug 04 10:31:55.390841 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 433/912] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:55 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:31:56.373994 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-de7a63ab-5d66-4c84-9986-962f4409120b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:56.374632 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-de7a63ab-5d66-4c84-9986-962f4409120b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:56.381241 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de7a63ab-5d66-4c84-9986-962f4409120b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:56.381717 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de7a63ab-5d66-4c84-9986-962f4409120b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:56.382525 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de7a63ab-5d66-4c84-9986-962f4409120b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:56.382983 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de7a63ab-5d66-4c84-9986-962f4409120b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:56.412523 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a0ac3900-e3ef-42c5-9397-d6508a8de1ab tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:56.413133 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a0ac3900-e3ef-42c5-9397-d6508a8de1ab tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:56.419963 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a0ac3900-e3ef-42c5-9397-d6508a8de1ab tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:56.420438 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a0ac3900-e3ef-42c5-9397-d6508a8de1ab tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:56.421240 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a0ac3900-e3ef-42c5-9397-d6508a8de1ab tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:56.421701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a0ac3900-e3ef-42c5-9397-d6508a8de1ab tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:56.560535 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-de7a63ab-5d66-4c84-9986-962f4409120b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:56.568745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-de7a63ab-5d66-4c84-9986-962f4409120b tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1677 microversion: 2.1 time: 0.198622 Aug 04 10:31:56.569309 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 480/913] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:56 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:56.588636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a0ac3900-e3ef-42c5-9397-d6508a8de1ab tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:56.596486 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a0ac3900-e3ef-42c5-9397-d6508a8de1ab tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:56.598006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-a0ac3900-e3ef-42c5-9397-d6508a8de1ab tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:56.599147 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a0ac3900-e3ef-42c5-9397-d6508a8de1ab tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1732 microversion: 2.20 time: 0.190515 Aug 04 10:31:56.599703 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 434/914] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:56 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:31:57.590052 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0a2b69c2-6948-4985-a536-e56b44b7531a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:57.590575 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0a2b69c2-6948-4985-a536-e56b44b7531a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:57.597452 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a2b69c2-6948-4985-a536-e56b44b7531a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:57.597912 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a2b69c2-6948-4985-a536-e56b44b7531a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:57.598698 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a2b69c2-6948-4985-a536-e56b44b7531a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:57.599136 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a2b69c2-6948-4985-a536-e56b44b7531a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:57.622219 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5a1a4037-6914-424c-a585-a71419feef0a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:57.622987 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5a1a4037-6914-424c-a585-a71419feef0a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:57.636705 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a1a4037-6914-424c-a585-a71419feef0a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:57.637165 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a1a4037-6914-424c-a585-a71419feef0a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:57.640330 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a1a4037-6914-424c-a585-a71419feef0a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:57.640779 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a1a4037-6914-424c-a585-a71419feef0a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:57.819040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-0a2b69c2-6948-4985-a536-e56b44b7531a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:57.828343 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5a1a4037-6914-424c-a585-a71419feef0a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:57.836258 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0a2b69c2-6948-4985-a536-e56b44b7531a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1677 microversion: 2.1 time: 0.250036 Aug 04 10:31:57.839262 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5a1a4037-6914-424c-a585-a71419feef0a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:57.840859 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5a1a4037-6914-424c-a585-a71419feef0a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:57.841952 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 481/915] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:57 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1677 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:31:57.843513 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5a1a4037-6914-424c-a585-a71419feef0a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1719 microversion: 2.20 time: 0.225911 Aug 04 10:31:57.855992 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 435/916] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:31:57 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1719 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:31:58.503983 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e4329490-14cd-4d0d-8b47-57dab31ab10b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:58.507019 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e4329490-14cd-4d0d-8b47-57dab31ab10b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:58.512181 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-00b10546-6389-4867-8096-9460d246824a req-4e8a2c56-c1f0-4c8f-9cec-a3cbc33ddf6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b55a1e93-26e7-4c91-bf51-5505f979d59b", "name": "network-vif-deleted", "tag": "a7735c18-ebb1-4ef0-9d8f-72b98cc4238f"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:31:58.514351 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e4329490-14cd-4d0d-8b47-57dab31ab10b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:58.514857 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e4329490-14cd-4d0d-8b47-57dab31ab10b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:58.515881 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e4329490-14cd-4d0d-8b47-57dab31ab10b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:58.516522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e4329490-14cd-4d0d-8b47-57dab31ab10b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:58.534001 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-00b10546-6389-4867-8096-9460d246824a req-4e8a2c56-c1f0-4c8f-9cec-a3cbc33ddf6b service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:58.534445 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-00b10546-6389-4867-8096-9460d246824a req-4e8a2c56-c1f0-4c8f-9cec-a3cbc33ddf6b service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:58.550076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-00b10546-6389-4867-8096-9460d246824a req-4e8a2c56-c1f0-4c8f-9cec-a3cbc33ddf6b service nova] Creating event network-vif-deleted:a7735c18-ebb1-4ef0-9d8f-72b98cc4238f for instance b55a1e93-26e7-4c91-bf51-5505f979d59b on hv-cinder-82660 Aug 04 10:31:58.555892 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e4329490-14cd-4d0d-8b47-57dab31ab10b tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056400 Aug 04 10:31:58.556231 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-00b10546-6389-4867-8096-9460d246824a req-4e8a2c56-c1f0-4c8f-9cec-a3cbc33ddf6b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047687 Aug 04 10:31:58.556861 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 436/917] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:31:58.557328 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 482/918] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:31:58 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:31:58.694602 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b2b874da-9b3b-4e27-8652-4dc73d60d4f1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:58.697043 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b2b874da-9b3b-4e27-8652-4dc73d60d4f1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:58.704176 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b2b874da-9b3b-4e27-8652-4dc73d60d4f1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:58.705662 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b2b874da-9b3b-4e27-8652-4dc73d60d4f1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:58.706653 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b2b874da-9b3b-4e27-8652-4dc73d60d4f1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:58.707266 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b2b874da-9b3b-4e27-8652-4dc73d60d4f1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:58.739670 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b2b874da-9b3b-4e27-8652-4dc73d60d4f1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051521 Aug 04 10:31:58.740590 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 437/919] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:31:58 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:31:58.814177 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c56b50c0-10da-4fa5-ae93-ea4daa556ad5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:58.814741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c56b50c0-10da-4fa5-ae93-ea4daa556ad5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:58.821205 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c56b50c0-10da-4fa5-ae93-ea4daa556ad5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:58.821661 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c56b50c0-10da-4fa5-ae93-ea4daa556ad5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:58.822437 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c56b50c0-10da-4fa5-ae93-ea4daa556ad5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:58.822879 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c56b50c0-10da-4fa5-ae93-ea4daa556ad5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:58.848862 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c56b50c0-10da-4fa5-ae93-ea4daa556ad5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:31:58.862402 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b98bcb6b-c598-40f9-a3c6-4a2220973eab tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:58.863189 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b98bcb6b-c598-40f9-a3c6-4a2220973eab tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:58.869689 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b98bcb6b-c598-40f9-a3c6-4a2220973eab tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:58.870255 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b98bcb6b-c598-40f9-a3c6-4a2220973eab tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:58.871130 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b98bcb6b-c598-40f9-a3c6-4a2220973eab tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:58.871673 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b98bcb6b-c598-40f9-a3c6-4a2220973eab tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:58.907238 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b98bcb6b-c598-40f9-a3c6-4a2220973eab tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:58.907878 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b98bcb6b-c598-40f9-a3c6-4a2220973eab tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:58.908476 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-b98bcb6b-c598-40f9-a3c6-4a2220973eab tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lazy-loading 'fault' on Instance uuid b55a1e93-26e7-4c91-bf51-5505f979d59b {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:31:58.933578 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c56b50c0-10da-4fa5-ae93-ea4daa556ad5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 204 len: 0 microversion: 2.1 time: 0.122460 Aug 04 10:31:58.934399 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 483/920] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:31:58 2022] DELETE /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:31:58.943538 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-002f223c-35b0-453f-b2ec-29b0cb9d73bf tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:58.944276 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-002f223c-35b0-453f-b2ec-29b0cb9d73bf tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:58.950439 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-002f223c-35b0-453f-b2ec-29b0cb9d73bf tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:58.950884 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-002f223c-35b0-453f-b2ec-29b0cb9d73bf tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:58.952227 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-002f223c-35b0-453f-b2ec-29b0cb9d73bf tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:58.952844 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-002f223c-35b0-453f-b2ec-29b0cb9d73bf tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:58.956193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b98bcb6b-c598-40f9-a3c6-4a2220973eab tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:58.964815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b98bcb6b-c598-40f9-a3c6-4a2220973eab tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1329 microversion: 2.1 time: 0.106385 Aug 04 10:31:58.972806 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 438/921] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:58 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1329 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:31:59.120271 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-002f223c-35b0-453f-b2ec-29b0cb9d73bf tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:31:59.131174 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-002f223c-35b0-453f-b2ec-29b0cb9d73bf tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 200 len: 1674 microversion: 2.1 time: 0.191716 Aug 04 10:31:59.132130 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 484/922] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:58 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 1674 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:31:59.988785 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-2410a651-cd4c-4d03-a74f-f293ac0c9ab3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:31:59.989401 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-2410a651-cd4c-4d03-a74f-f293ac0c9ab3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:31:59.995604 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2410a651-cd4c-4d03-a74f-f293ac0c9ab3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:59.996086 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2410a651-cd4c-4d03-a74f-f293ac0c9ab3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:31:59.996847 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2410a651-cd4c-4d03-a74f-f293ac0c9ab3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:31:59.997283 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2410a651-cd4c-4d03-a74f-f293ac0c9ab3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:00.026403 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2410a651-cd4c-4d03-a74f-f293ac0c9ab3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:00.026849 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-2410a651-cd4c-4d03-a74f-f293ac0c9ab3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:00.027292 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.objects.instance [None req-2410a651-cd4c-4d03-a74f-f293ac0c9ab3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lazy-loading 'fault' on Instance uuid b55a1e93-26e7-4c91-bf51-5505f979d59b {{(pid=117667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:32:00.067639 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-2410a651-cd4c-4d03-a74f-f293ac0c9ab3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b680411b142642b7acc3585d2481f880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e51ae816f4dc6b7dac8c2ddcf38bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:32:00.075051 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-2410a651-cd4c-4d03-a74f-f293ac0c9ab3 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 200 len: 1329 microversion: 2.1 time: 0.090230 Aug 04 10:32:00.075615 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 439/923] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:31:59 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 1329 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:32:00.153186 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9fae7355-c249-4ac4-964e-4120097d47c0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:00.153885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9fae7355-c249-4ac4-964e-4120097d47c0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:00.161052 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9fae7355-c249-4ac4-964e-4120097d47c0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:00.161542 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9fae7355-c249-4ac4-964e-4120097d47c0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:00.162383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9fae7355-c249-4ac4-964e-4120097d47c0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:00.162948 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9fae7355-c249-4ac4-964e-4120097d47c0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:00.296964 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9fae7355-c249-4ac4-964e-4120097d47c0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:32:00.305250 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9fae7355-c249-4ac4-964e-4120097d47c0 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 200 len: 1674 microversion: 2.1 time: 0.155872 Aug 04 10:32:00.305822 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 485/924] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:32:00 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:32:01.094859 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1e95d4d2-356c-44a4-aea7-913f3511c64f tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:01.096633 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-1e95d4d2-356c-44a4-aea7-913f3511c64f tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:01.104483 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1e95d4d2-356c-44a4-aea7-913f3511c64f tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:01.104991 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1e95d4d2-356c-44a4-aea7-913f3511c64f tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:01.105840 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1e95d4d2-356c-44a4-aea7-913f3511c64f tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:01.106279 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1e95d4d2-356c-44a4-aea7-913f3511c64f tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:01.123083 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-1e95d4d2-356c-44a4-aea7-913f3511c64f tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] HTTP exception thrown: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1e95d4d2-356c-44a4-aea7-913f3511c64f tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Request method failure captured: Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b HTTP/1.1 Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656Tob97WbD_ZS5F2g-QN7pC61pEa9bei56wET8TrZeizeYQWOy31gmFZi3BtMbEG-sSRMiaAjSOk7-SIrWX3R_-R1F1qjTprnkQ7VwtSLuza02D0xNMbtZfy2jBcBSsmOWIl7uTSBWVqK40vdniduqG7S6ibX_f6b3y_2MqFav-ZhA Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:32:01.125525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:32:01.127184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:01.127184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:01.127184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:01.127184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:01.127184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:01.127184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:32:01.127184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:32:01.127184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: b680411b142642b7acc3585d2481f880 Aug 04 10:32:01.127184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:01.127184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:32:01.127184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:01.127184 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': 'b55a1e93-26e7-4c91-bf51-5505f979d59b'} Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:01.128076 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:01.129708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:01.130921 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1e95d4d2-356c-44a4-aea7-913f3511c64f tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Returning 404 to user: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:01.132738 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-1e95d4d2-356c-44a4-aea7-913f3511c64f tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 404 len: 111 microversion: 2.1 time: 0.041250 Aug 04 10:32:01.133199 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 440/925] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:32:01 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:01.141290 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bd392ba0-33de-41ff-839f-e8ad22ebf09d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '.version_select at 0x7fbaa4e67280>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:01.163282 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bd392ba0-33de-41ff-839f-e8ad22ebf09d tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-45067599" status: 202 len: 0 microversion: 2.1 time: 0.025246 Aug 04 10:32:01.164777 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 486/926] 10.222.0.72 () {58 vars in 1215 bytes} [Thu Aug 4 10:32:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-45067599 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:32:01.327333 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-919f10f3-e8c6-4e1c-a449-98ba24b3e23c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:01.327946 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-919f10f3-e8c6-4e1c-a449-98ba24b3e23c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:01.334336 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-919f10f3-e8c6-4e1c-a449-98ba24b3e23c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:01.334790 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-919f10f3-e8c6-4e1c-a449-98ba24b3e23c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:01.335570 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-919f10f3-e8c6-4e1c-a449-98ba24b3e23c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:01.336026 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-919f10f3-e8c6-4e1c-a449-98ba24b3e23c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:01.615287 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-919f10f3-e8c6-4e1c-a449-98ba24b3e23c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac9aa3a8d7a4383b9211cbac185a325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888ab157217942abaf98b99e8eb827de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:32:01.624616 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-919f10f3-e8c6-4e1c-a449-98ba24b3e23c tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 200 len: 1674 microversion: 2.1 time: 0.301794 Aug 04 10:32:01.625197 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 441/927] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:32:01 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 1674 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:32:02.082673 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-4680b50a-2dd3-489b-8540-accdf16ba776 req-dce69cd2-0929-41cb-b049-a35184f2fdb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f07bbd9-4e21-48ad-8ab9-fe9af12060be", "name": "network-vif-deleted", "tag": "21c372bf-56d3-49ad-8df8-029534399855"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:32:02.093257 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-4680b50a-2dd3-489b-8540-accdf16ba776 req-dce69cd2-0929-41cb-b049-a35184f2fdb5 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:02.093697 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-4680b50a-2dd3-489b-8540-accdf16ba776 req-dce69cd2-0929-41cb-b049-a35184f2fdb5 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:02.105124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-4680b50a-2dd3-489b-8540-accdf16ba776 req-dce69cd2-0929-41cb-b049-a35184f2fdb5 service nova] Creating event network-vif-deleted:21c372bf-56d3-49ad-8df8-029534399855 for instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be on hv-cinder-82660 Aug 04 10:32:02.110759 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-4680b50a-2dd3-489b-8540-accdf16ba776 req-dce69cd2-0929-41cb-b049-a35184f2fdb5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031656 Aug 04 10:32:02.114290 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 487/928] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:02.646153 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4900c771-a80e-4c0a-8012-fd5395590eb1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:02.646756 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4900c771-a80e-4c0a-8012-fd5395590eb1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:02.653459 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4900c771-a80e-4c0a-8012-fd5395590eb1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:02.653902 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4900c771-a80e-4c0a-8012-fd5395590eb1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:02.655231 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4900c771-a80e-4c0a-8012-fd5395590eb1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:02.655659 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4900c771-a80e-4c0a-8012-fd5395590eb1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:02.670640 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-4900c771-a80e-4c0a-8012-fd5395590eb1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] HTTP exception thrown: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4900c771-a80e-4c0a-8012-fd5395590eb1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Request method failure captured: Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be HTTP/1.1 Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656LIUmaJXn-WJ6_eQYITzPtjT6AqDPxBPS6Eo190Dc6E1IcObF-fA7Psf8oyPmurxgByqUueSdJ5XSRXtI_rFWE0v-kIoiC7Im0XIr_c3V5yiKb8WkJWFLog_g5KiJJw1PPBpWZAoJ_6kiqLVWkcgLt-ufZ2rRKsWIzixsZwsyANRw Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 888ab157217942abaf98b99e8eb827de Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:32:02.672210 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:32:02.673819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/888ab157217942abaf98b99e8eb827de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/888ab157217942abaf98b99e8eb827de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/888ab157217942abaf98b99e8eb827de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_888ab157217942abaf98b99e8eb827de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:02.673819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:02.673819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 888ab157217942abaf98b99e8eb827de Aug 04 10:32:02.673819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:02.673819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-AttachVolumeTestJSON-4512277-project Aug 04 10:32:02.673819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:32:02.673819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:32:02.673819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: 0ac9aa3a8d7a4383b9211cbac185a325 Aug 04 10:32:02.673819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-AttachVolumeTestJSON-4512277-project Aug 04 10:32:02.673819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:32:02.673819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:02.673819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '7f07bbd9-4e21-48ad-8ab9-fe9af12060be'} Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:02.674626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:02.676057 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:02.677668 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4900c771-a80e-4c0a-8012-fd5395590eb1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Returning 404 to user: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:02.677668 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4900c771-a80e-4c0a-8012-fd5395590eb1 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 404 len: 111 microversion: 2.1 time: 0.031393 Aug 04 10:32:02.677668 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 442/929] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:32:02 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:02.683830 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e5b4e9ba-1047-4709-966a-afef6007ca86 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '.version_select at 0x7fbaa4f300d0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:02.702880 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e5b4e9ba-1047-4709-966a-afef6007ca86 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503271122" status: 202 len: 0 microversion: 2.1 time: 0.023595 Aug 04 10:32:02.703458 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 488/930] 10.222.0.72 () {58 vars in 1221 bytes} [Thu Aug 4 10:32:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503271122 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:32:03.072363 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a7368bae-5baa-4b56-811b-bdb602f265d6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:03.072854 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a7368bae-5baa-4b56-811b-bdb602f265d6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:03.079499 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a7368bae-5baa-4b56-811b-bdb602f265d6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:03.080102 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a7368bae-5baa-4b56-811b-bdb602f265d6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:03.081001 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a7368bae-5baa-4b56-811b-bdb602f265d6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:03.081645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a7368bae-5baa-4b56-811b-bdb602f265d6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:03.098465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-a7368bae-5baa-4b56-811b-bdb602f265d6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] HTTP exception thrown: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a7368bae-5baa-4b56-811b-bdb602f265d6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Request method failure captured: Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: DELETE /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b HTTP/1.1 Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656Tob97WbD_ZS5F2g-QN7pC61pEa9bei56wET8TrZeizeYQWOy31gmFZi3BtMbEG-sSRMiaAjSOk7-SIrWX3R_-R1F1qjTprnkQ7VwtSLuza02D0xNMbtZfy2jBcBSsmOWIl7uTSBWVqK40vdniduqG7S6ibX_f6b3y_2MqFav-ZhA Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:32:03.100205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:32:03.101701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:03.101701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:03.101701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:03.101701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:03.101701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:03.101701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:32:03.101701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:32:03.101701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: b680411b142642b7acc3585d2481f880 Aug 04 10:32:03.101701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:03.101701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:32:03.101701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:03.101701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': 'b55a1e93-26e7-4c91-bf51-5505f979d59b'} Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:03.102509 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:03.103820 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:03.106220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a7368bae-5baa-4b56-811b-bdb602f265d6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Returning 404 to user: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:03.106220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a7368bae-5baa-4b56-811b-bdb602f265d6 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 404 len: 111 microversion: 2.1 time: 0.033886 Aug 04 10:32:03.106220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 443/931] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:32:03 2022] DELETE /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:03.111408 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-aec48e27-2759-4766-a349-71a268eefcb4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:03.112159 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-aec48e27-2759-4766-a349-71a268eefcb4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: b55a1e93-26e7-4c91-bf51-5505f979d59b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:03.120971 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aec48e27-2759-4766-a349-71a268eefcb4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:03.121499 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aec48e27-2759-4766-a349-71a268eefcb4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:03.122377 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aec48e27-2759-4766-a349-71a268eefcb4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:03.122917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-aec48e27-2759-4766-a349-71a268eefcb4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:03.137785 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-aec48e27-2759-4766-a349-71a268eefcb4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] HTTP exception thrown: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-aec48e27-2759-4766-a349-71a268eefcb4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Request method failure captured: Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b HTTP/1.1 Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656Tob97WbD_ZS5F2g-QN7pC61pEa9bei56wET8TrZeizeYQWOy31gmFZi3BtMbEG-sSRMiaAjSOk7-SIrWX3R_-R1F1qjTprnkQ7VwtSLuza02D0xNMbtZfy2jBcBSsmOWIl7uTSBWVqK40vdniduqG7S6ibX_f6b3y_2MqFav-ZhA Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:32:03.139591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:32:03.141153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:03.141153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:03.141153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:03.141153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:03.141153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:03.141153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:32:03.141153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:32:03.141153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: b680411b142642b7acc3585d2481f880 Aug 04 10:32:03.141153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:03.141153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:32:03.141153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:03.141153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': 'b55a1e93-26e7-4c91-bf51-5505f979d59b'} Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:03.142037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. Aug 04 10:32:03.143493 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:03.144815 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-aec48e27-2759-4766-a349-71a268eefcb4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Returning 404 to user: Instance b55a1e93-26e7-4c91-bf51-5505f979d59b could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:03.144815 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-aec48e27-2759-4766-a349-71a268eefcb4 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b" status: 404 len: 111 microversion: 2.1 time: 0.034375 Aug 04 10:32:03.144815 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 489/932] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:32:03 2022] GET /compute/v2.1/servers/b55a1e93-26e7-4c91-bf51-5505f979d59b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:04.306607 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a6a76079-8406-43be-99db-e599eacaf111 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:04.307107 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a6a76079-8406-43be-99db-e599eacaf111 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:04.313414 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a6a76079-8406-43be-99db-e599eacaf111 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:04.313856 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a6a76079-8406-43be-99db-e599eacaf111 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:04.314599 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a6a76079-8406-43be-99db-e599eacaf111 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:04.315032 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a6a76079-8406-43be-99db-e599eacaf111 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:04.319146 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:32:04.329620 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-a6a76079-8406-43be-99db-e599eacaf111 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] HTTP exception thrown: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a6a76079-8406-43be-99db-e599eacaf111 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Request method failure captured: Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: DELETE /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 HTTP/1.1 Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656Tob97WbD_ZS5F2g-QN7pC61pEa9bei56wET8TrZeizeYQWOy31gmFZi3BtMbEG-sSRMiaAjSOk7-SIrWX3R_-R1F1qjTprnkQ7VwtSLuza02D0xNMbtZfy2jBcBSsmOWIl7uTSBWVqK40vdniduqG7S6ibX_f6b3y_2MqFav-ZhA Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:32:04.331158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:32:04.332793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:04.332793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:04.332793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:04.332793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:04.332793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:04.332793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:32:04.332793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:32:04.332793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: b680411b142642b7acc3585d2481f880 Aug 04 10:32:04.332793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:04.332793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:32:04.332793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:32:04.332793 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '228506d2-27e6-4bab-991d-0695ea9543c3'} Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:04.333701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:32:04.335127 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.336612 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a6a76079-8406-43be-99db-e599eacaf111 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Returning 404 to user: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:04.336612 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a6a76079-8406-43be-99db-e599eacaf111 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 404 len: 111 microversion: 2.1 time: 0.029792 Aug 04 10:32:04.336612 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 444/933] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:32:04 2022] DELETE /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:04.341286 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cd716be5-5538-4806-a663-5363e6448b50 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:04.342503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-cd716be5-5538-4806-a663-5363e6448b50 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 228506d2-27e6-4bab-991d-0695ea9543c3] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:04.348718 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cd716be5-5538-4806-a663-5363e6448b50 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:04.349205 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cd716be5-5538-4806-a663-5363e6448b50 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:04.349974 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cd716be5-5538-4806-a663-5363e6448b50 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:04.350414 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-cd716be5-5538-4806-a663-5363e6448b50 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:04.363535 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-cd716be5-5538-4806-a663-5363e6448b50 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] HTTP exception thrown: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cd716be5-5538-4806-a663-5363e6448b50 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Request method failure captured: Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 HTTP/1.1 Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656Tob97WbD_ZS5F2g-QN7pC61pEa9bei56wET8TrZeizeYQWOy31gmFZi3BtMbEG-sSRMiaAjSOk7-SIrWX3R_-R1F1qjTprnkQ7VwtSLuza02D0xNMbtZfy2jBcBSsmOWIl7uTSBWVqK40vdniduqG7S6ibX_f6b3y_2MqFav-ZhA Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:32:04.365152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:32:04.366741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:04.366741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:04.366741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:04.366741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:04.366741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:04.366741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:32:04.366741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:32:04.366741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: b680411b142642b7acc3585d2481f880 Aug 04 10:32:04.366741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:04.366741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:32:04.366741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:32:04.366741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '228506d2-27e6-4bab-991d-0695ea9543c3'} Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:04.367622 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. Aug 04 10:32:04.369051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.370559 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-cd716be5-5538-4806-a663-5363e6448b50 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Returning 404 to user: Instance 228506d2-27e6-4bab-991d-0695ea9543c3 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:04.370559 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-cd716be5-5538-4806-a663-5363e6448b50 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3" status: 404 len: 111 microversion: 2.1 time: 0.029071 Aug 04 10:32:04.370559 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 490/934] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:32:04 2022] GET /compute/v2.1/servers/228506d2-27e6-4bab-991d-0695ea9543c3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:04.375229 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9a078d34-cc27-4de0-b3cb-e76734e605df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:04.375709 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9a078d34-cc27-4de0-b3cb-e76734e605df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:04.382664 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a078d34-cc27-4de0-b3cb-e76734e605df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:04.383099 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a078d34-cc27-4de0-b3cb-e76734e605df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:04.383847 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a078d34-cc27-4de0-b3cb-e76734e605df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:04.384303 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9a078d34-cc27-4de0-b3cb-e76734e605df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:04.398429 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-9a078d34-cc27-4de0-b3cb-e76734e605df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] HTTP exception thrown: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9a078d34-cc27-4de0-b3cb-e76734e605df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Request method failure captured: Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: DELETE /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 HTTP/1.1 Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656Tob97WbD_ZS5F2g-QN7pC61pEa9bei56wET8TrZeizeYQWOy31gmFZi3BtMbEG-sSRMiaAjSOk7-SIrWX3R_-R1F1qjTprnkQ7VwtSLuza02D0xNMbtZfy2jBcBSsmOWIl7uTSBWVqK40vdniduqG7S6ibX_f6b3y_2MqFav-ZhA Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:32:04.400066 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:32:04.401593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:04.401593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:04.401593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:04.401593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:04.401593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:04.401593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:32:04.401593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:32:04.401593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: b680411b142642b7acc3585d2481f880 Aug 04 10:32:04.401593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:04.401593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:32:04.401593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:32:04.401593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '323e8a06-ea21-43a6-a575-4973b1616653'} Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:04.402484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:32:04.403995 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.405986 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9a078d34-cc27-4de0-b3cb-e76734e605df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Returning 404 to user: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:04.405986 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9a078d34-cc27-4de0-b3cb-e76734e605df tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 404 len: 111 microversion: 2.1 time: 0.030295 Aug 04 10:32:04.405986 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 445/935] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:32:04 2022] DELETE /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:04.410656 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-935bd581-f326-4d1d-96a4-2aa6bf6f8a15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:04.411269 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-935bd581-f326-4d1d-96a4-2aa6bf6f8a15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 323e8a06-ea21-43a6-a575-4973b1616653] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:04.417472 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-935bd581-f326-4d1d-96a4-2aa6bf6f8a15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:04.417927 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-935bd581-f326-4d1d-96a4-2aa6bf6f8a15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:04.418692 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-935bd581-f326-4d1d-96a4-2aa6bf6f8a15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:04.419137 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-935bd581-f326-4d1d-96a4-2aa6bf6f8a15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:04.432615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-935bd581-f326-4d1d-96a4-2aa6bf6f8a15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] HTTP exception thrown: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-935bd581-f326-4d1d-96a4-2aa6bf6f8a15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Request method failure captured: Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 HTTP/1.1 Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656Tob97WbD_ZS5F2g-QN7pC61pEa9bei56wET8TrZeizeYQWOy31gmFZi3BtMbEG-sSRMiaAjSOk7-SIrWX3R_-R1F1qjTprnkQ7VwtSLuza02D0xNMbtZfy2jBcBSsmOWIl7uTSBWVqK40vdniduqG7S6ibX_f6b3y_2MqFav-ZhA Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:32:04.434129 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:32:04.436152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:04.436152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:04.436152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:04.436152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:04.436152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:04.436152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:32:04.436152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:32:04.436152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: b680411b142642b7acc3585d2481f880 Aug 04 10:32:04.436152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:04.436152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:32:04.436152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:32:04.436152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '323e8a06-ea21-43a6-a575-4973b1616653'} Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:04.437031 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. Aug 04 10:32:04.438434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:04.439803 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-935bd581-f326-4d1d-96a4-2aa6bf6f8a15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Returning 404 to user: Instance 323e8a06-ea21-43a6-a575-4973b1616653 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:04.439803 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-935bd581-f326-4d1d-96a4-2aa6bf6f8a15 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653" status: 404 len: 111 microversion: 2.1 time: 0.028744 Aug 04 10:32:04.439803 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 491/936] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:32:04 2022] GET /compute/v2.1/servers/323e8a06-ea21-43a6-a575-4973b1616653 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:05.595092 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b0c2118a-6cd5-4efb-9340-3e9601de2c61 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:05.595594 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b0c2118a-6cd5-4efb-9340-3e9601de2c61 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:05.604082 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b0c2118a-6cd5-4efb-9340-3e9601de2c61 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:05.604540 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b0c2118a-6cd5-4efb-9340-3e9601de2c61 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:05.605295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b0c2118a-6cd5-4efb-9340-3e9601de2c61 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:05.605721 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b0c2118a-6cd5-4efb-9340-3e9601de2c61 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:05.619687 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-b0c2118a-6cd5-4efb-9340-3e9601de2c61 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] HTTP exception thrown: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b0c2118a-6cd5-4efb-9340-3e9601de2c61 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Request method failure captured: Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: DELETE /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb HTTP/1.1 Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656Tob97WbD_ZS5F2g-QN7pC61pEa9bei56wET8TrZeizeYQWOy31gmFZi3BtMbEG-sSRMiaAjSOk7-SIrWX3R_-R1F1qjTprnkQ7VwtSLuza02D0xNMbtZfy2jBcBSsmOWIl7uTSBWVqK40vdniduqG7S6ibX_f6b3y_2MqFav-ZhA Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:32:05.621257 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:32:05.622786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:05.622786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:05.622786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:05.622786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:05.622786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:05.622786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:32:05.622786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:32:05.622786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: b680411b142642b7acc3585d2481f880 Aug 04 10:32:05.622786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:05.622786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:32:05.622786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:32:05.622786 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '1d55a58c-f47e-4284-9ffa-f7fb642845fb'} Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:05.623632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:32:05.624876 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.626085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b0c2118a-6cd5-4efb-9340-3e9601de2c61 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Returning 404 to user: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:05.626085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b0c2118a-6cd5-4efb-9340-3e9601de2c61 tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 404 len: 111 microversion: 2.1 time: 0.032367 Aug 04 10:32:05.626085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 446/937] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:32:05 2022] DELETE /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:05.631372 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-adae06b4-6cb5-46a3-8e1c-bb2452f0fa9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:05.631981 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-adae06b4-6cb5-46a3-8e1c-bb2452f0fa9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] [instance: 1d55a58c-f47e-4284-9ffa-f7fb642845fb] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:05.639207 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-adae06b4-6cb5-46a3-8e1c-bb2452f0fa9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:05.639666 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-adae06b4-6cb5-46a3-8e1c-bb2452f0fa9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:05.640466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-adae06b4-6cb5-46a3-8e1c-bb2452f0fa9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:05.640895 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-adae06b4-6cb5-46a3-8e1c-bb2452f0fa9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:05.654583 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-adae06b4-6cb5-46a3-8e1c-bb2452f0fa9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] HTTP exception thrown: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-adae06b4-6cb5-46a3-8e1c-bb2452f0fa9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Request method failure captured: Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb HTTP/1.1 Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656Tob97WbD_ZS5F2g-QN7pC61pEa9bei56wET8TrZeizeYQWOy31gmFZi3BtMbEG-sSRMiaAjSOk7-SIrWX3R_-R1F1qjTprnkQ7VwtSLuza02D0xNMbtZfy2jBcBSsmOWIl7uTSBWVqK40vdniduqG7S6ibX_f6b3y_2MqFav-ZhA Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:32:05.656638 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:32:05.658208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ae1e51ae816f4dc6b7dac8c2ddcf38bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:05.658208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:05.658208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: ae1e51ae816f4dc6b7dac8c2ddcf38bc Aug 04 10:32:05.658208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1199018973 Aug 04 10:32:05.658208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:05.658208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:32:05.658208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:32:05.658208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: b680411b142642b7acc3585d2481f880 Aug 04 10:32:05.658208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeNegativeTest-1199018973-project Aug 04 10:32:05.658208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:32:05.658208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:32:05.658208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '1d55a58c-f47e-4284-9ffa-f7fb642845fb'} Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:05.662522 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. Aug 04 10:32:05.664407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.665698 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dc229b85-0918-40df-802c-42c81d3dd7e5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:05.665794 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-adae06b4-6cb5-46a3-8e1c-bb2452f0fa9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] Returning 404 to user: Instance 1d55a58c-f47e-4284-9ffa-f7fb642845fb could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:05.665894 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dc229b85-0918-40df-802c-42c81d3dd7e5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:05.665995 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-adae06b4-6cb5-46a3-8e1c-bb2452f0fa9a tempest-AttachVolumeNegativeTest-1199018973 tempest-AttachVolumeNegativeTest-1199018973-project] 10.222.0.72 "GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb" status: 404 len: 111 microversion: 2.1 time: 0.030800 Aug 04 10:32:05.665995 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 492/938] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:32:05 2022] GET /compute/v2.1/servers/1d55a58c-f47e-4284-9ffa-f7fb642845fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 10:32:05.666153 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dc229b85-0918-40df-802c-42c81d3dd7e5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:05.666153 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dc229b85-0918-40df-802c-42c81d3dd7e5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:05.666153 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dc229b85-0918-40df-802c-42c81d3dd7e5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:05.666153 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dc229b85-0918-40df-802c-42c81d3dd7e5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:05.680996 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-dc229b85-0918-40df-802c-42c81d3dd7e5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] HTTP exception thrown: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dc229b85-0918-40df-802c-42c81d3dd7e5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Request method failure captured: Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: DELETE /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be HTTP/1.1 Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656LIUmaJXn-WJ6_eQYITzPtjT6AqDPxBPS6Eo190Dc6E1IcObF-fA7Psf8oyPmurxgByqUueSdJ5XSRXtI_rFWE0v-kIoiC7Im0XIr_c3V5yiKb8WkJWFLog_g5KiJJw1PPBpWZAoJ_6kiqLVWkcgLt-ufZ2rRKsWIzixsZwsyANRw Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 888ab157217942abaf98b99e8eb827de Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:32:05.682547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:32:05.684149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/888ab157217942abaf98b99e8eb827de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/888ab157217942abaf98b99e8eb827de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/888ab157217942abaf98b99e8eb827de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_888ab157217942abaf98b99e8eb827de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:05.684149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:05.684149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 888ab157217942abaf98b99e8eb827de Aug 04 10:32:05.684149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:05.684149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-AttachVolumeTestJSON-4512277-project Aug 04 10:32:05.684149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:32:05.684149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:32:05.684149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: 0ac9aa3a8d7a4383b9211cbac185a325 Aug 04 10:32:05.684149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-AttachVolumeTestJSON-4512277-project Aug 04 10:32:05.684149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:32:05.684149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:05.684149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '7f07bbd9-4e21-48ad-8ab9-fe9af12060be'} Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:05.685028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:05.686579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.688502 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dc229b85-0918-40df-802c-42c81d3dd7e5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Returning 404 to user: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:05.688502 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-dc229b85-0918-40df-802c-42c81d3dd7e5 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 404 len: 111 microversion: 2.1 time: 0.031288 Aug 04 10:32:05.688502 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 447/939] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:32:05 2022] DELETE /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 10:32:05.692782 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-51d1a32c-e529-4ded-8c76-1566653eddc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:05.693394 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-51d1a32c-e529-4ded-8c76-1566653eddc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: 7f07bbd9-4e21-48ad-8ab9-fe9af12060be] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:05.699333 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-51d1a32c-e529-4ded-8c76-1566653eddc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:05.699779 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-51d1a32c-e529-4ded-8c76-1566653eddc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:05.700571 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-51d1a32c-e529-4ded-8c76-1566653eddc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:05.701002 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-51d1a32c-e529-4ded-8c76-1566653eddc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:05.715908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-51d1a32c-e529-4ded-8c76-1566653eddc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] HTTP exception thrown: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-51d1a32c-e529-4ded-8c76-1566653eddc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Request method failure captured: Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be HTTP/1.1 Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656LIUmaJXn-WJ6_eQYITzPtjT6AqDPxBPS6Eo190Dc6E1IcObF-fA7Psf8oyPmurxgByqUueSdJ5XSRXtI_rFWE0v-kIoiC7Im0XIr_c3V5yiKb8WkJWFLog_g5KiJJw1PPBpWZAoJ_6kiqLVWkcgLt-ufZ2rRKsWIzixsZwsyANRw Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 888ab157217942abaf98b99e8eb827de Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:32:05.716833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:32:05.718932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/888ab157217942abaf98b99e8eb827de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/888ab157217942abaf98b99e8eb827de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/888ab157217942abaf98b99e8eb827de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_888ab157217942abaf98b99e8eb827de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:05.718932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:05.718932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 888ab157217942abaf98b99e8eb827de Aug 04 10:32:05.718932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:05.718932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeTestJSON-4512277-project Aug 04 10:32:05.718932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:32:05.718932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:32:05.718932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: 0ac9aa3a8d7a4383b9211cbac185a325 Aug 04 10:32:05.718932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeTestJSON-4512277-project Aug 04 10:32:05.718932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:32:05.718932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:05.718932 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '7f07bbd9-4e21-48ad-8ab9-fe9af12060be'} Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:05.719807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. Aug 04 10:32:05.721908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:05.725843 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-51d1a32c-e529-4ded-8c76-1566653eddc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Returning 404 to user: Instance 7f07bbd9-4e21-48ad-8ab9-fe9af12060be could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:05.725843 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-51d1a32c-e529-4ded-8c76-1566653eddc3 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be" status: 404 len: 111 microversion: 2.1 time: 0.030002 Aug 04 10:32:05.725843 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 493/940] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:32:05 2022] GET /compute/v2.1/servers/7f07bbd9-4e21-48ad-8ab9-fe9af12060be => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:06.864451 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-de1ff6ee-9be7-4099-927d-c5e5dc32f907 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:06.865016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-de1ff6ee-9be7-4099-927d-c5e5dc32f907 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:06.871759 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-de1ff6ee-9be7-4099-927d-c5e5dc32f907 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:06.872325 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-de1ff6ee-9be7-4099-927d-c5e5dc32f907 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:06.873163 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-de1ff6ee-9be7-4099-927d-c5e5dc32f907 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:06.873702 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-de1ff6ee-9be7-4099-927d-c5e5dc32f907 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:06.886965 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-de1ff6ee-9be7-4099-927d-c5e5dc32f907 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] HTTP exception thrown: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-de1ff6ee-9be7-4099-927d-c5e5dc32f907 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Request method failure captured: Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: DELETE /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 HTTP/1.1 Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656LIUmaJXn-WJ6_eQYITzPtjT6AqDPxBPS6Eo190Dc6E1IcObF-fA7Psf8oyPmurxgByqUueSdJ5XSRXtI_rFWE0v-kIoiC7Im0XIr_c3V5yiKb8WkJWFLog_g5KiJJw1PPBpWZAoJ_6kiqLVWkcgLt-ufZ2rRKsWIzixsZwsyANRw Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 888ab157217942abaf98b99e8eb827de Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:32:06.888638 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:32:06.890264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/888ab157217942abaf98b99e8eb827de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/888ab157217942abaf98b99e8eb827de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/888ab157217942abaf98b99e8eb827de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_888ab157217942abaf98b99e8eb827de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:06.890264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:06.890264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 888ab157217942abaf98b99e8eb827de Aug 04 10:32:06.890264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:06.890264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-AttachVolumeTestJSON-4512277-project Aug 04 10:32:06.890264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:32:06.890264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:32:06.890264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: 0ac9aa3a8d7a4383b9211cbac185a325 Aug 04 10:32:06.890264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-AttachVolumeTestJSON-4512277-project Aug 04 10:32:06.890264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:32:06.890264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:32:06.890264 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': 'cf60275d-fda6-4f0c-8a2f-14f85d685623'} Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:06.891022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:32:06.892610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:06.894018 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-de1ff6ee-9be7-4099-927d-c5e5dc32f907 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Returning 404 to user: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:06.894018 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-de1ff6ee-9be7-4099-927d-c5e5dc32f907 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 404 len: 111 microversion: 2.1 time: 0.029521 Aug 04 10:32:06.894018 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 448/941] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:32:06 2022] DELETE /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:06.898491 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b3c18f0a-4994-4ba8-aef2-b68dcc0a2ca8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:06.899105 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b3c18f0a-4994-4ba8-aef2-b68dcc0a2ca8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] [instance: cf60275d-fda6-4f0c-8a2f-14f85d685623] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:06.906162 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3c18f0a-4994-4ba8-aef2-b68dcc0a2ca8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:06.906616 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3c18f0a-4994-4ba8-aef2-b68dcc0a2ca8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:06.907383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3c18f0a-4994-4ba8-aef2-b68dcc0a2ca8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:06.907816 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b3c18f0a-4994-4ba8-aef2-b68dcc0a2ca8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:06.923500 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-b3c18f0a-4994-4ba8-aef2-b68dcc0a2ca8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] HTTP exception thrown: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b3c18f0a-4994-4ba8-aef2-b68dcc0a2ca8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Request method failure captured: Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 HTTP/1.1 Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656LIUmaJXn-WJ6_eQYITzPtjT6AqDPxBPS6Eo190Dc6E1IcObF-fA7Psf8oyPmurxgByqUueSdJ5XSRXtI_rFWE0v-kIoiC7Im0XIr_c3V5yiKb8WkJWFLog_g5KiJJw1PPBpWZAoJ_6kiqLVWkcgLt-ufZ2rRKsWIzixsZwsyANRw Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 888ab157217942abaf98b99e8eb827de Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:32:06.925067 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:32:06.926814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/888ab157217942abaf98b99e8eb827de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/888ab157217942abaf98b99e8eb827de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/888ab157217942abaf98b99e8eb827de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_888ab157217942abaf98b99e8eb827de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:06.926814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:06.926814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 888ab157217942abaf98b99e8eb827de Aug 04 10:32:06.926814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeTestJSON-4512277 Aug 04 10:32:06.926814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeTestJSON-4512277-project Aug 04 10:32:06.926814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:32:06.926814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:32:06.926814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: 0ac9aa3a8d7a4383b9211cbac185a325 Aug 04 10:32:06.926814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeTestJSON-4512277-project Aug 04 10:32:06.926814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:32:06.926814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:32:06.926814 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': 'cf60275d-fda6-4f0c-8a2f-14f85d685623'} Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:06.928800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. Aug 04 10:32:06.930817 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:06.932923 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b3c18f0a-4994-4ba8-aef2-b68dcc0a2ca8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] Returning 404 to user: Instance cf60275d-fda6-4f0c-8a2f-14f85d685623 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:06.932923 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b3c18f0a-4994-4ba8-aef2-b68dcc0a2ca8 tempest-AttachVolumeTestJSON-4512277 tempest-AttachVolumeTestJSON-4512277-project] 10.222.0.72 "GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623" status: 404 len: 111 microversion: 2.1 time: 0.031832 Aug 04 10:32:06.932923 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 494/942] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:32:06 2022] GET /compute/v2.1/servers/cf60275d-fda6-4f0c-8a2f-14f85d685623 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:13.188726 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-57764324-103e-4031-b72a-78af95b3c744 tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] Calling method '.version_select at 0x7fbaa47ad8b0>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:13.237939 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-57764324-103e-4031-b72a-78af95b3c744 tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/2096c24c-b0d4-4399-b7be-a92482560879" status: 200 len: 351 microversion: 2.1 time: 0.052955 Aug 04 10:32:13.238588 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 449/943] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:32:13 2022] GET /compute/v2.1/os-volumes/2096c24c-b0d4-4399-b7be-a92482560879 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:14.571342 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-1ee03130-8bd8-4420-9f73-e63cfa3e2716 tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] Calling method '.version_select at 0x7fbaa4f19550>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:14.627701 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-1ee03130-8bd8-4420-9f73-e63cfa3e2716 tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/50b0deb8-25c0-4e49-ac27-b7f57c28c1a9" status: 200 len: 349 microversion: 2.1 time: 0.061612 Aug 04 10:32:14.628312 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 495/944] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:32:14 2022] GET /compute/v2.1/os-volumes/50b0deb8-25c0-4e49-ac27-b7f57c28c1a9 => generated 349 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:15.976008 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f89b3093-7ac2-44af-85c4-e4bc35dafdad tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] Calling method '.version_select at 0x7fbaa479c550>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:16.027578 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f89b3093-7ac2-44af-85c4-e4bc35dafdad tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/065bddd8-5d72-4dae-ba10-8f1fe98b26e4" status: 200 len: 351 microversion: 2.1 time: 0.055810 Aug 04 10:32:16.028191 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 450/945] 10.222.0.72 () {58 vars in 1245 bytes} [Thu Aug 4 10:32:15 2022] GET /compute/v2.1/os-volumes/065bddd8-5d72-4dae-ba10-8f1fe98b26e4 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:16.041253 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-af0d3463-d919-4a14-b207-46cc02edb9de tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] Calling method '.version_select at 0x7fbaa4fccd30>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:16.123712 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-af0d3463-d919-4a14-b207-46cc02edb9de tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086010 Aug 04 10:32:16.124374 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 496/946] 10.222.0.72 () {58 vars in 1134 bytes} [Thu Aug 4 10:32:16 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:32:16.137628 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7cf02c75-9140-40fd-b7de-77703a0ff136 tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] Calling method '.version_select at 0x7fbaa4848820>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:16.221787 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7cf02c75-9140-40fd-b7de-77703a0ff136 tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087728 Aug 04 10:32:16.222566 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 451/947] 10.222.0.72 () {58 vars in 1149 bytes} [Thu Aug 4 10:32:16 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:16.241254 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a0b0cd39-d724-4212-ba44-1f1282e046f8 tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] Calling method '.version_select at 0x7fbaa4e748b0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:16.326800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a0b0cd39-d724-4212-ba44-1f1282e046f8 tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.094846 Aug 04 10:32:16.327243 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 497/948] 10.222.0.72 () {58 vars in 1134 bytes} [Thu Aug 4 10:32:16 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:32:16.339790 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-cffd044e-5d21-4896-8454-c77d9b69c4d3 tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] Calling method '.version_select at 0x7fbaa97ea5e0>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:16.422316 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-cffd044e-5d21-4896-8454-c77d9b69c4d3 tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.086161 Aug 04 10:32:16.422888 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 452/949] 10.222.0.72 () {58 vars in 1167 bytes} [Thu Aug 4 10:32:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:16.436585 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a841c2e8-09c5-43d6-99b3-bc87a1d501a5 tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] Calling method '.version_select at 0x7fbaa4e74160>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:16.519116 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a841c2e8-09c5-43d6-99b3-bc87a1d501a5 tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086771 Aug 04 10:32:16.519689 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 498/950] 10.222.0.72 () {58 vars in 1170 bytes} [Thu Aug 4 10:32:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:16.533748 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-26f3ea27-3ea5-4fce-9c76-41a3ebeb366f tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] Calling method '.version_select at 0x7fbaa47ad790>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:16.630319 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-26f3ea27-3ea5-4fce-9c76-41a3ebeb366f tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.101060 Aug 04 10:32:16.630899 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 453/951] 10.222.0.72 () {58 vars in 1155 bytes} [Thu Aug 4 10:32:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:32:16.646769 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f11ec14e-722a-4c65-bdc2-ba65d4f3708b tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] Calling method '.version_select at 0x7fbaa4fcc3a0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:16.734087 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f11ec14e-722a-4c65-bdc2-ba65d4f3708b tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.092740 Aug 04 10:32:16.734589 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 499/952] 10.222.0.72 () {58 vars in 1188 bytes} [Thu Aug 4 10:32:16 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:16.747300 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-cdccff79-a355-4c55-be59-ceb2cbbc940f tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] Calling method '.version_select at 0x7fbaa4b6d940>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:16.830621 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-cdccff79-a355-4c55-be59-ceb2cbbc940f tempest-VolumesTestJSON-1924188098 tempest-VolumesTestJSON-1924188098-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086931 Aug 04 10:32:16.831155 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 454/953] 10.222.0.72 () {58 vars in 1155 bytes} [Thu Aug 4 10:32:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:32:37.110054 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:32:37.110828 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:32:37.115869 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f6c71481-9a2d-47d9-a24f-dde7a820dae1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:37.118667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f6c71481-9a2d-47d9-a24f-dde7a820dae1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:37.126784 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f6c71481-9a2d-47d9-a24f-dde7a820dae1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:37.127234 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f6c71481-9a2d-47d9-a24f-dde7a820dae1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:37.128038 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f6c71481-9a2d-47d9-a24f-dde7a820dae1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:37.128472 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f6c71481-9a2d-47d9-a24f-dde7a820dae1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:37.158816 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f6c71481-9a2d-47d9-a24f-dde7a820dae1 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049510 Aug 04 10:32:37.159391 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 500/954] 10.222.0.72 () {60 vars in 1343 bytes} [Thu Aug 4 10:32:37 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:32:37.222299 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-34395d0e-1c67-4a41-856b-58af81fdc6a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:37.222785 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-34395d0e-1c67-4a41-856b-58af81fdc6a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:37.224910 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:32:37.225721 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=8 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:32:37.232531 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-34395d0e-1c67-4a41-856b-58af81fdc6a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:37.232986 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-34395d0e-1c67-4a41-856b-58af81fdc6a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:37.233758 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-34395d0e-1c67-4a41-856b-58af81fdc6a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:37.234200 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-34395d0e-1c67-4a41-856b-58af81fdc6a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:37.261410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-34395d0e-1c67-4a41-856b-58af81fdc6a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Going to try to terminate instance {{(pid=117667) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:32:37.359564 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-34395d0e-1c67-4a41-856b-58af81fdc6a9 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "DELETE /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 204 len: 0 microversion: 2.20 time: 0.140836 Aug 04 10:32:37.360491 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 455/955] 10.222.0.72 () {60 vars in 1280 bytes} [Thu Aug 4 10:32:37 2022] DELETE /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 10:32:37.369535 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-61f58506-f40b-4ef9-a6ed-cb921159592f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:37.370229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-61f58506-f40b-4ef9-a6ed-cb921159592f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:37.377142 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61f58506-f40b-4ef9-a6ed-cb921159592f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:37.377689 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61f58506-f40b-4ef9-a6ed-cb921159592f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:37.378534 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61f58506-f40b-4ef9-a6ed-cb921159592f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:37.379048 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61f58506-f40b-4ef9-a6ed-cb921159592f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:37.536861 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-61f58506-f40b-4ef9-a6ed-cb921159592f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:32:37.545207 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-61f58506-f40b-4ef9-a6ed-cb921159592f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:32:37.546716 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-61f58506-f40b-4ef9-a6ed-cb921159592f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:32:37.547870 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-61f58506-f40b-4ef9-a6ed-cb921159592f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.182727 Aug 04 10:32:37.548460 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 501/956] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:32:37 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:32:38.571894 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6ba36f77-c8cb-466a-a240-8ad17a28f25c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:38.572629 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6ba36f77-c8cb-466a-a240-8ad17a28f25c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:38.579597 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ba36f77-c8cb-466a-a240-8ad17a28f25c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:38.581750 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ba36f77-c8cb-466a-a240-8ad17a28f25c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:38.582542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ba36f77-c8cb-466a-a240-8ad17a28f25c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:38.582982 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ba36f77-c8cb-466a-a240-8ad17a28f25c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:38.722790 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6ba36f77-c8cb-466a-a240-8ad17a28f25c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:32:38.730966 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6ba36f77-c8cb-466a-a240-8ad17a28f25c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:32:38.732599 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6ba36f77-c8cb-466a-a240-8ad17a28f25c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:32:38.733772 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6ba36f77-c8cb-466a-a240-8ad17a28f25c tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1725 microversion: 2.20 time: 0.166163 Aug 04 10:32:38.734324 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 456/957] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:32:38 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:32:39.756075 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8a5b0055-df73-4d21-8bc2-e9a342cbe207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:39.756689 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8a5b0055-df73-4d21-8bc2-e9a342cbe207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:39.764177 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a5b0055-df73-4d21-8bc2-e9a342cbe207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:39.764634 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a5b0055-df73-4d21-8bc2-e9a342cbe207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:39.765419 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a5b0055-df73-4d21-8bc2-e9a342cbe207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:39.765858 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a5b0055-df73-4d21-8bc2-e9a342cbe207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:39.835158 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8a5b0055-df73-4d21-8bc2-e9a342cbe207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:32:39.844988 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8a5b0055-df73-4d21-8bc2-e9a342cbe207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:32:39.846427 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8a5b0055-df73-4d21-8bc2-e9a342cbe207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7213149649d249f2b2da3d6c7dac0a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35576cef915b41419fc74b0beea0f988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:32:39.847583 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8a5b0055-df73-4d21-8bc2-e9a342cbe207 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 200 len: 1657 microversion: 2.20 time: 0.095446 Aug 04 10:32:39.848193 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 502/958] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:32:39 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 1657 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:32:39.925239 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-09eaa826-617c-4ccd-b6da-2b49c5cf7193 req-f8999aac-c82c-463b-80f0-d01f10f4ba02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d953ca9-81b0-46f6-af0f-22e198ddb24b", "name": "network-vif-deleted", "tag": "e506b457-5f08-48b5-9d0b-c71bdf4640ec"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:32:39.937614 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-09eaa826-617c-4ccd-b6da-2b49c5cf7193 req-f8999aac-c82c-463b-80f0-d01f10f4ba02 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:39.938361 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-09eaa826-617c-4ccd-b6da-2b49c5cf7193 req-f8999aac-c82c-463b-80f0-d01f10f4ba02 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:39.950446 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-09eaa826-617c-4ccd-b6da-2b49c5cf7193 req-f8999aac-c82c-463b-80f0-d01f10f4ba02 service nova] Creating event network-vif-deleted:e506b457-5f08-48b5-9d0b-c71bdf4640ec for instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b on hv-cinder-82660 Aug 04 10:32:39.956524 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-09eaa826-617c-4ccd-b6da-2b49c5cf7193 req-f8999aac-c82c-463b-80f0-d01f10f4ba02 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034916 Aug 04 10:32:39.957138 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 457/959] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:40.873246 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9ca6a70b-813d-445d-8429-e4302b11d1ca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:40.874823 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9ca6a70b-813d-445d-8429-e4302b11d1ca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:40.882757 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9ca6a70b-813d-445d-8429-e4302b11d1ca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:40.883544 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9ca6a70b-813d-445d-8429-e4302b11d1ca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:40.884725 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9ca6a70b-813d-445d-8429-e4302b11d1ca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:40.885321 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9ca6a70b-813d-445d-8429-e4302b11d1ca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:40.903582 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-9ca6a70b-813d-445d-8429-e4302b11d1ca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] HTTP exception thrown: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9ca6a70b-813d-445d-8429-e4302b11d1ca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Request method failure captured: Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b HTTP/1.1 Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656SwTM9jFF0y2HhOYUn9XpqxKP43wqAawwvL-y7y22HyJSYp7A-f0tgbKreB7IFdOsNuEgaHRVERhzxBQUTeQlMJ_xKlABcQbIlqX3JwrfHnXs9q-HdNbNMEADiKM1m5QOSljzTqvMb6XvkaXCKQ_yEUKGvZ-quN7FtPVDZ57C5CoI Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 35576cef915b41419fc74b0beea0f988 Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:32:40.906383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:32:40.907842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/35576cef915b41419fc74b0beea0f988"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/35576cef915b41419fc74b0beea0f988"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/35576cef915b41419fc74b0beea0f988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_35576cef915b41419fc74b0beea0f988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:40.907842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:40.907842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 35576cef915b41419fc74b0beea0f988 Aug 04 10:32:40.907842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:40.907842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeShelveTestJSON-791276795-project Aug 04 10:32:40.907842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:32:40.907842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:32:40.907842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: 7213149649d249f2b2da3d6c7dac0a68 Aug 04 10:32:40.907842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791276795-project Aug 04 10:32:40.907842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:32:40.907842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:40.907842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '6d953ca9-81b0-46f6-af0f-22e198ddb24b'} Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:40.908906 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:40.910471 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:40.916115 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9ca6a70b-813d-445d-8429-e4302b11d1ca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Returning 404 to user: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:40.920980 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9ca6a70b-813d-445d-8429-e4302b11d1ca tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 404 len: 111 microversion: 2.20 time: 0.052495 Aug 04 10:32:40.924337 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 503/960] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:32:40 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:32:40.931036 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9977cc4b-42ed-49ea-aaa2-2439050bbd43 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '.version_select at 0x7fbaa47ad280>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:40.956818 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9977cc4b-42ed-49ea-aaa2-2439050bbd43 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200881194" status: 204 len: 0 microversion: 2.20 time: 0.030205 Aug 04 10:32:40.957395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 458/961] 10.222.0.72 () {60 vars in 1262 bytes} [Thu Aug 4 10:32:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200881194 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 10:32:42.815178 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8ab644e0-7c4b-4857-92ff-e5ecd71d6df3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:42.815675 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8ab644e0-7c4b-4857-92ff-e5ecd71d6df3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:42.822740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8ab644e0-7c4b-4857-92ff-e5ecd71d6df3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:42.823185 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8ab644e0-7c4b-4857-92ff-e5ecd71d6df3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:42.823943 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8ab644e0-7c4b-4857-92ff-e5ecd71d6df3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:42.824394 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8ab644e0-7c4b-4857-92ff-e5ecd71d6df3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:42.838755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-8ab644e0-7c4b-4857-92ff-e5ecd71d6df3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] HTTP exception thrown: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8ab644e0-7c4b-4857-92ff-e5ecd71d6df3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Request method failure captured: Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b HTTP/1.1 Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656SwTM9jFF0y2HhOYUn9XpqxKP43wqAawwvL-y7y22HyJSYp7A-f0tgbKreB7IFdOsNuEgaHRVERhzxBQUTeQlMJ_xKlABcQbIlqX3JwrfHnXs9q-HdNbNMEADiKM1m5QOSljzTqvMb6XvkaXCKQ_yEUKGvZ-quN7FtPVDZ57C5CoI Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 35576cef915b41419fc74b0beea0f988 Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:32:42.840379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:32:42.842024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/35576cef915b41419fc74b0beea0f988"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/35576cef915b41419fc74b0beea0f988"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/35576cef915b41419fc74b0beea0f988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_35576cef915b41419fc74b0beea0f988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:42.842024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:42.842024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 35576cef915b41419fc74b0beea0f988 Aug 04 10:32:42.842024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:42.842024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeShelveTestJSON-791276795-project Aug 04 10:32:42.842024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:32:42.842024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:32:42.842024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: 7213149649d249f2b2da3d6c7dac0a68 Aug 04 10:32:42.842024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791276795-project Aug 04 10:32:42.842024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:32:42.842024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:42.842024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '6d953ca9-81b0-46f6-af0f-22e198ddb24b'} Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:42.842863 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:42.844203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:42.845532 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8ab644e0-7c4b-4857-92ff-e5ecd71d6df3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Returning 404 to user: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:42.845532 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8ab644e0-7c4b-4857-92ff-e5ecd71d6df3 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "DELETE /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 404 len: 111 microversion: 2.20 time: 0.031493 Aug 04 10:32:42.845532 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 504/962] 10.222.0.72 () {60 vars in 1280 bytes} [Thu Aug 4 10:32:42 2022] DELETE /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:32:42.850492 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5902c81a-bd73-4640-a72f-fca796065cb7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:42.851297 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5902c81a-bd73-4640-a72f-fca796065cb7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 6d953ca9-81b0-46f6-af0f-22e198ddb24b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:42.859321 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5902c81a-bd73-4640-a72f-fca796065cb7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:42.859771 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5902c81a-bd73-4640-a72f-fca796065cb7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:42.860652 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5902c81a-bd73-4640-a72f-fca796065cb7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:42.861090 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5902c81a-bd73-4640-a72f-fca796065cb7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:42.876130 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-5902c81a-bd73-4640-a72f-fca796065cb7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] HTTP exception thrown: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5902c81a-bd73-4640-a72f-fca796065cb7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Request method failure captured: Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b HTTP/1.1 Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656SwTM9jFF0y2HhOYUn9XpqxKP43wqAawwvL-y7y22HyJSYp7A-f0tgbKreB7IFdOsNuEgaHRVERhzxBQUTeQlMJ_xKlABcQbIlqX3JwrfHnXs9q-HdNbNMEADiKM1m5QOSljzTqvMb6XvkaXCKQ_yEUKGvZ-quN7FtPVDZ57C5CoI Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 35576cef915b41419fc74b0beea0f988 Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:32:42.876636 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:32:42.878295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/35576cef915b41419fc74b0beea0f988"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/35576cef915b41419fc74b0beea0f988"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/35576cef915b41419fc74b0beea0f988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_35576cef915b41419fc74b0beea0f988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:42.878295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:42.878295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 35576cef915b41419fc74b0beea0f988 Aug 04 10:32:42.878295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:42.878295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-AttachVolumeShelveTestJSON-791276795-project Aug 04 10:32:42.878295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:32:42.878295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:32:42.878295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: 7213149649d249f2b2da3d6c7dac0a68 Aug 04 10:32:42.878295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791276795-project Aug 04 10:32:42.878295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:32:42.878295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:42.878295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '6d953ca9-81b0-46f6-af0f-22e198ddb24b'} Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:42.879187 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. Aug 04 10:32:42.880618 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:42.881911 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5902c81a-bd73-4640-a72f-fca796065cb7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Returning 404 to user: Instance 6d953ca9-81b0-46f6-af0f-22e198ddb24b could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:42.881911 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5902c81a-bd73-4640-a72f-fca796065cb7 tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b" status: 404 len: 111 microversion: 2.20 time: 0.031419 Aug 04 10:32:42.881911 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 459/963] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:32:42 2022] GET /compute/v2.1/servers/6d953ca9-81b0-46f6-af0f-22e198ddb24b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:32:44.183164 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6f8befbc-c52c-4282-b378-e4811bdda57f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:44.183649 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6f8befbc-c52c-4282-b378-e4811bdda57f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:44.190649 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6f8befbc-c52c-4282-b378-e4811bdda57f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:44.191095 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6f8befbc-c52c-4282-b378-e4811bdda57f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:44.191860 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6f8befbc-c52c-4282-b378-e4811bdda57f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:44.192320 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6f8befbc-c52c-4282-b378-e4811bdda57f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:44.208917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-6f8befbc-c52c-4282-b378-e4811bdda57f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] HTTP exception thrown: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6f8befbc-c52c-4282-b378-e4811bdda57f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Request method failure captured: Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b HTTP/1.1 Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi656SwTM9jFF0y2HhOYUn9XpqxKP43wqAawwvL-y7y22HyJSYp7A-f0tgbKreB7IFdOsNuEgaHRVERhzxBQUTeQlMJ_xKlABcQbIlqX3JwrfHnXs9q-HdNbNMEADiKM1m5QOSljzTqvMb6XvkaXCKQ_yEUKGvZ-quN7FtPVDZ57C5CoI Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 35576cef915b41419fc74b0beea0f988 Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:32:44.211543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:32:44.218049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/35576cef915b41419fc74b0beea0f988"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/35576cef915b41419fc74b0beea0f988"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/35576cef915b41419fc74b0beea0f988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_35576cef915b41419fc74b0beea0f988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:44.218049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:44.218049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 35576cef915b41419fc74b0beea0f988 Aug 04 10:32:44.218049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:44.218049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-AttachVolumeShelveTestJSON-791276795-project Aug 04 10:32:44.218049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:32:44.218049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:32:44.218049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: 7213149649d249f2b2da3d6c7dac0a68 Aug 04 10:32:44.218049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791276795-project Aug 04 10:32:44.218049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:32:44.218049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:32:44.218049 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '0396f5e6-1b64-4b0f-9352-28165af5878b'} Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:44.219560 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:32:44.223229 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:32:44.225813 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6f8befbc-c52c-4282-b378-e4811bdda57f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Returning 404 to user: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:44.225813 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6f8befbc-c52c-4282-b378-e4811bdda57f tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 404 len: 111 microversion: 2.20 time: 0.033554 Aug 04 10:32:44.225813 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 505/964] 10.222.0.72 () {60 vars in 1280 bytes} [Thu Aug 4 10:32:44 2022] DELETE /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:32:44.231022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-044e9a0a-56b3-406c-a752-23b3d060a63a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:44.231022 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-044e9a0a-56b3-406c-a752-23b3d060a63a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] [instance: 0396f5e6-1b64-4b0f-9352-28165af5878b] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:32:44.232645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-044e9a0a-56b3-406c-a752-23b3d060a63a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:44.233093 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-044e9a0a-56b3-406c-a752-23b3d060a63a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:44.233891 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-044e9a0a-56b3-406c-a752-23b3d060a63a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:44.234332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-044e9a0a-56b3-406c-a752-23b3d060a63a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:44.253540 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-044e9a0a-56b3-406c-a752-23b3d060a63a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] HTTP exception thrown: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-044e9a0a-56b3-406c-a752-23b3d060a63a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Request method failure captured: Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b HTTP/1.1 Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi656SwTM9jFF0y2HhOYUn9XpqxKP43wqAawwvL-y7y22HyJSYp7A-f0tgbKreB7IFdOsNuEgaHRVERhzxBQUTeQlMJ_xKlABcQbIlqX3JwrfHnXs9q-HdNbNMEADiKM1m5QOSljzTqvMb6XvkaXCKQ_yEUKGvZ-quN7FtPVDZ57C5CoI Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 35576cef915b41419fc74b0beea0f988 Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:32:44.255067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:32:44.256815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/35576cef915b41419fc74b0beea0f988"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/35576cef915b41419fc74b0beea0f988"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/35576cef915b41419fc74b0beea0f988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_35576cef915b41419fc74b0beea0f988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:32:44.256815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:44.256815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 35576cef915b41419fc74b0beea0f988 Aug 04 10:32:44.256815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791276795 Aug 04 10:32:44.256815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-AttachVolumeShelveTestJSON-791276795-project Aug 04 10:32:44.256815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:32:44.256815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:32:44.256815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: 7213149649d249f2b2da3d6c7dac0a68 Aug 04 10:32:44.256815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791276795-project Aug 04 10:32:44.256815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:32:44.256815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:32:44.256815 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '0396f5e6-1b64-4b0f-9352-28165af5878b'} Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:44.257711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. Aug 04 10:32:44.259295 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:32:44.260654 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-044e9a0a-56b3-406c-a752-23b3d060a63a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] Returning 404 to user: Instance 0396f5e6-1b64-4b0f-9352-28165af5878b could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:44.260654 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-044e9a0a-56b3-406c-a752-23b3d060a63a tempest-AttachVolumeShelveTestJSON-791276795 tempest-AttachVolumeShelveTestJSON-791276795-project] 10.222.0.72 "GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b" status: 404 len: 111 microversion: 2.20 time: 0.037320 Aug 04 10:32:44.260654 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 460/965] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Aug 4 10:32:44 2022] GET /compute/v2.1/servers/0396f5e6-1b64-4b0f-9352-28165af5878b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 10:33:32.502637 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1254651964", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-274711633", "security_groups": [{"name": "tempest-secgroup-smoke-1551120339"}], "block_device_mapping_v2": [{"uuid": "4b3fb75f-f870-42b5-89e6-1f88199ef703", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3eadf84-c470-4284-bd83-89e428b31aa1"}]}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:32.538719 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=12 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:32.543675 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=24 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:32.769176 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.network.neutron [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] validate_networks() for [('a3eadf84-c470-4284-bd83-89e428b31aa1', None, None, None, None, None)] {{(pid=117666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:33:33.833000 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Flavor limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:33:33.833717 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Image limits 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:33:33.834741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Flavor pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:33:33.836524 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Image pref 0:0:0 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:33:33.837716 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.virt.hardware [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:33:33.858218 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:33.859060 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:33.859996 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:33.860558 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:33.883501 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Getting quotas for project 82b077dd80c54b08ba3ad79b8cafd3f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:33:33.888761 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Getting quotas for user fd829e78e710440687678701fea3cf2c and project 82b077dd80c54b08ba3ad79b8cafd3f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:33:33.988692 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Going to run 1 instances... {{(pid=117666) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:33:34.004142 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b3fb75f-f870-42b5-89e6-1f88199ef703',volume_size=None,volume_type=None)] {{(pid=117666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:33:34.241217 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [6710c3f8-7919-4161-bba3-515cde95ccab] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 10:33:35.262351 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO oslo.messaging._drivers.impl_rabbit [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [6710c3f8-7919-4161-bba3-515cde95ccab] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 40762. Aug 04 10:33:35.283781 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d4fb34d4-de25-4fd0-a22f-9d210ee0b51b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.785131 Aug 04 10:33:35.285604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 506/966] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:33:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 2788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:33:35.298880 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-84680412-347d-4dc8-ad93-091385185634 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:35.300615 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-84680412-347d-4dc8-ad93-091385185634 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:35.305452 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:35.306877 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:35.398388 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-84680412-347d-4dc8-ad93-091385185634 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:35.408293 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-84680412-347d-4dc8-ad93-091385185634 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1094 microversion: 2.1 time: 0.114759 Aug 04 10:33:35.409482 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 461/967] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:35 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1094 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:36.432579 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b9018302-8967-4fd6-ace0-2b420ed283bf tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:36.435769 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b9018302-8967-4fd6-ace0-2b420ed283bf tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:36.516218 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b9018302-8967-4fd6-ace0-2b420ed283bf tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:36.525426 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b9018302-8967-4fd6-ace0-2b420ed283bf tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1094 microversion: 2.1 time: 0.099546 Aug 04 10:33:36.526745 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 507/968] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:36 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1094 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:37.548277 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-7b7ba35a-d1bc-4ba4-a873-fec4b334080c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:37.548888 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-7b7ba35a-d1bc-4ba4-a873-fec4b334080c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:37.634580 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-7b7ba35a-d1bc-4ba4-a873-fec4b334080c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:37.645180 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-7b7ba35a-d1bc-4ba4-a873-fec4b334080c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1094 microversion: 2.1 time: 0.101535 Aug 04 10:33:37.645956 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 462/969] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:37 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1094 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:38.665779 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d809725a-0268-46ec-8697-2ce82669e15d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:38.667940 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d809725a-0268-46ec-8697-2ce82669e15d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:38.746800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d809725a-0268-46ec-8697-2ce82669e15d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:38.757407 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d809725a-0268-46ec-8697-2ce82669e15d tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1094 microversion: 2.1 time: 0.095298 Aug 04 10:33:38.757976 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 508/970] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:38 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1094 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:39.779334 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-37222e14-f502-4ea1-a3f0-79c053ae22ae tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:39.780072 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-37222e14-f502-4ea1-a3f0-79c053ae22ae tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:39.787004 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-37222e14-f502-4ea1-a3f0-79c053ae22ae tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:39.789143 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-37222e14-f502-4ea1-a3f0-79c053ae22ae tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:39.790125 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-37222e14-f502-4ea1-a3f0-79c053ae22ae tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:39.790934 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-37222e14-f502-4ea1-a3f0-79c053ae22ae tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:39.875991 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-37222e14-f502-4ea1-a3f0-79c053ae22ae tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:39.883909 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-37222e14-f502-4ea1-a3f0-79c053ae22ae tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1144 microversion: 2.1 time: 0.108948 Aug 04 10:33:39.897722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 463/971] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:39 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1144 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:40.905297 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-48619c41-a9ec-4697-a31a-c653b4d4213c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:40.906605 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-48619c41-a9ec-4697-a31a-c653b4d4213c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:40.913740 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-48619c41-a9ec-4697-a31a-c653b4d4213c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:40.914319 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-48619c41-a9ec-4697-a31a-c653b4d4213c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:40.915228 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-48619c41-a9ec-4697-a31a-c653b4d4213c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:40.915759 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-48619c41-a9ec-4697-a31a-c653b4d4213c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:40.984901 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-48619c41-a9ec-4697-a31a-c653b4d4213c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:40.992892 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-48619c41-a9ec-4697-a31a-c653b4d4213c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1144 microversion: 2.1 time: 0.092352 Aug 04 10:33:40.993637 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 509/972] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:40 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:42.013843 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4e6654aa-b4cb-46f2-942c-4de6d3f210da tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:42.015074 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4e6654aa-b4cb-46f2-942c-4de6d3f210da tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:42.027978 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4e6654aa-b4cb-46f2-942c-4de6d3f210da tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:42.031232 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4e6654aa-b4cb-46f2-942c-4de6d3f210da tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:42.032040 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4e6654aa-b4cb-46f2-942c-4de6d3f210da tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:42.032796 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4e6654aa-b4cb-46f2-942c-4de6d3f210da tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:42.122844 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4e6654aa-b4cb-46f2-942c-4de6d3f210da tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:42.138599 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4e6654aa-b4cb-46f2-942c-4de6d3f210da tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1136 microversion: 2.1 time: 0.128840 Aug 04 10:33:42.139488 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 464/973] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:42 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1136 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:43.164186 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4810d219-5694-400d-b633-79e83eee3616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:43.165519 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4810d219-5694-400d-b633-79e83eee3616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:43.172831 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4810d219-5694-400d-b633-79e83eee3616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:43.173647 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4810d219-5694-400d-b633-79e83eee3616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:43.181053 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4810d219-5694-400d-b633-79e83eee3616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:43.181837 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4810d219-5694-400d-b633-79e83eee3616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:43.299051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4810d219-5694-400d-b633-79e83eee3616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:43.313078 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4810d219-5694-400d-b633-79e83eee3616 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1210 microversion: 2.1 time: 0.152811 Aug 04 10:33:43.316072 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 510/974] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:43 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:44.337010 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f05c7109-f681-4ebb-bb33-0aa027e2c0b1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:44.338212 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f05c7109-f681-4ebb-bb33-0aa027e2c0b1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:44.344830 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f05c7109-f681-4ebb-bb33-0aa027e2c0b1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:44.345465 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f05c7109-f681-4ebb-bb33-0aa027e2c0b1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:44.346381 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f05c7109-f681-4ebb-bb33-0aa027e2c0b1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:44.347067 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f05c7109-f681-4ebb-bb33-0aa027e2c0b1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:44.381742 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-3c375843-b8a3-45c1-82fd-36a587c42334 req-7377ab51-a475-42fc-85b3-2e337d19957b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b53386c-d4ab-449c-a60a-bcb1aaff42ea", "tag": "f73efd39-7084-4080-b354-dd511042f3ee"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:44.386540 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:44.407648 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-3c375843-b8a3-45c1-82fd-36a587c42334 req-7377ab51-a475-42fc-85b3-2e337d19957b service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:44.408120 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-3c375843-b8a3-45c1-82fd-36a587c42334 req-7377ab51-a475-42fc-85b3-2e337d19957b service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:44.428155 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-3c375843-b8a3-45c1-82fd-36a587c42334 req-7377ab51-a475-42fc-85b3-2e337d19957b service nova] Creating event network-changed:f73efd39-7084-4080-b354-dd511042f3ee for instance 5b53386c-d4ab-449c-a60a-bcb1aaff42ea on hv-cinder-82660 Aug 04 10:33:44.439434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-3c375843-b8a3-45c1-82fd-36a587c42334 req-7377ab51-a475-42fc-85b3-2e337d19957b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061138 Aug 04 10:33:44.440733 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 511/975] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:33:44.504060 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f05c7109-f681-4ebb-bb33-0aa027e2c0b1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:44.512304 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f05c7109-f681-4ebb-bb33-0aa027e2c0b1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.179088 Aug 04 10:33:44.512960 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 465/976] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:44 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:44.907873 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ff73a306-64c5-47ca-b038-5f427f76b862 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Action: 'create', calling method: .version_select at 0x7fbaa4e4b430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-196869657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz+yzkeebSMBen2V52FyjL0jn8Rleo3FHt4eNoUOD26ltK0aLmnVG/yuzzlH0NPFSy4lP/hMwvdsje6lVZa+yZ1dT+Itq2E2vByawyCpcrVQ98w78qPTfp9OuDgc8rSiw=="}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:44.923312 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-ff73a306-64c5-47ca-b038-5f427f76b862 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Getting quotas for project f63d8ac72593445089042fd7c3a31651. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:33:44.927389 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.quota [None req-ff73a306-64c5-47ca-b038-5f427f76b862 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Getting quotas for user edd0f098e40c4c2da8d55df9a8fa0912 and project f63d8ac72593445089042fd7c3a31651. Resources: {'key_pairs'} {{(pid=117666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:33:44.948642 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ff73a306-64c5-47ca-b038-5f427f76b862 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045566 Aug 04 10:33:44.949220 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 512/977] 10.222.0.72 () {60 vars in 1159 bytes} [Thu Aug 4 10:33:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:33:45.054707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1764297723", "imageRef": "4ff25bb1-969a-4f6e-9944-2109594f0e1f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-196869657", "networks": [{"uuid": "176498d9-21ab-4075-9ce9-14751c0b91d3"}]}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:45.105959 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.network.neutron [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] validate_networks() for [('176498d9-21ab-4075-9ce9-14751c0b91d3', None, None, None, None, None)] {{(pid=117667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:33:45.486984 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Flavor limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:33:45.487608 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Image limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:33:45.488041 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Flavor pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:33:45.488474 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Image pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:33:45.488873 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:33:45.498996 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:45.499453 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:45.500288 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:45.500733 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:45.517930 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Getting quotas for project f63d8ac72593445089042fd7c3a31651. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:33:45.521887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Getting quotas for user edd0f098e40c4c2da8d55df9a8fa0912 and project f63d8ac72593445089042fd7c3a31651. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:33:45.532747 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Going to run 1 instances... {{(pid=117667) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:33:45.534374 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f04fa3a3-241e-4b6e-aef6-419b6a829cb1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:45.534938 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4ff25bb1-969a-4f6e-9944-2109594f0e1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:33:45.535101 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f04fa3a3-241e-4b6e-aef6-419b6a829cb1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:45.541742 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f04fa3a3-241e-4b6e-aef6-419b6a829cb1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:45.542194 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f04fa3a3-241e-4b6e-aef6-419b6a829cb1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:45.542949 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f04fa3a3-241e-4b6e-aef6-419b6a829cb1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:45.543381 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f04fa3a3-241e-4b6e-aef6-419b6a829cb1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:45.583033 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a6bea3a1-a27a-4d31-bfe5-88f1c57ccd62 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532251 Aug 04 10:33:45.584353 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 466/978] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:33:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:33:45.594674 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f1b74883-8b2e-465e-b7b3-4211950cb5a8 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:45.595291 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f1b74883-8b2e-465e-b7b3-4211950cb5a8 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:45.659159 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f1b74883-8b2e-465e-b7b3-4211950cb5a8 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:45.666701 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f1b74883-8b2e-465e-b7b3-4211950cb5a8 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1258 microversion: 2.1 time: 0.076083 Aug 04 10:33:45.667764 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 467/979] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:45 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:45.720196 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f04fa3a3-241e-4b6e-aef6-419b6a829cb1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:45.728131 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f04fa3a3-241e-4b6e-aef6-419b6a829cb1 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.198016 Aug 04 10:33:45.728695 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 513/980] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:45 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:46.687472 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-37cfc5ef-55f8-431d-8d9b-08462b338db3 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:46.688120 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-37cfc5ef-55f8-431d-8d9b-08462b338db3 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:46.695937 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-37cfc5ef-55f8-431d-8d9b-08462b338db3 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:46.696402 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-37cfc5ef-55f8-431d-8d9b-08462b338db3 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:46.697163 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-37cfc5ef-55f8-431d-8d9b-08462b338db3 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:46.697589 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-37cfc5ef-55f8-431d-8d9b-08462b338db3 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:46.749171 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-98ec3164-4a68-425e-b832-91b905ce9ba0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:46.749874 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-98ec3164-4a68-425e-b832-91b905ce9ba0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:46.756637 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-98ec3164-4a68-425e-b832-91b905ce9ba0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:46.757151 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-98ec3164-4a68-425e-b832-91b905ce9ba0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:46.757542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-37cfc5ef-55f8-431d-8d9b-08462b338db3 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:46.758052 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-98ec3164-4a68-425e-b832-91b905ce9ba0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:46.758547 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-98ec3164-4a68-425e-b832-91b905ce9ba0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:46.765639 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-37cfc5ef-55f8-431d-8d9b-08462b338db3 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1262 microversion: 2.1 time: 0.082110 Aug 04 10:33:46.766204 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 468/981] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:46 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:46.886392 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-98ec3164-4a68-425e-b832-91b905ce9ba0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:46.894424 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-98ec3164-4a68-425e-b832-91b905ce9ba0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.149178 Aug 04 10:33:46.894993 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 514/982] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:46 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:47.786896 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dea25e01-6666-4611-a8a3-e7e26613e1b1 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:47.787535 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dea25e01-6666-4611-a8a3-e7e26613e1b1 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:47.794708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dea25e01-6666-4611-a8a3-e7e26613e1b1 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:47.795156 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dea25e01-6666-4611-a8a3-e7e26613e1b1 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:47.795919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dea25e01-6666-4611-a8a3-e7e26613e1b1 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:47.796378 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dea25e01-6666-4611-a8a3-e7e26613e1b1 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:47.864796 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-dea25e01-6666-4611-a8a3-e7e26613e1b1 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:47.873301 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-dea25e01-6666-4611-a8a3-e7e26613e1b1 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1316 microversion: 2.1 time: 0.089938 Aug 04 10:33:47.873992 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 469/983] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:47 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1316 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:47.916581 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-49f513a9-b82e-4236-9ef4-0357e4012428 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:47.918292 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-49f513a9-b82e-4236-9ef4-0357e4012428 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:47.928282 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49f513a9-b82e-4236-9ef4-0357e4012428 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:47.928738 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49f513a9-b82e-4236-9ef4-0357e4012428 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:47.929883 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49f513a9-b82e-4236-9ef4-0357e4012428 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:47.930329 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49f513a9-b82e-4236-9ef4-0357e4012428 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:48.089360 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-49f513a9-b82e-4236-9ef4-0357e4012428 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:48.100543 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-49f513a9-b82e-4236-9ef4-0357e4012428 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.188545 Aug 04 10:33:48.112755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 515/984] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:47 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:48.899542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6730e9cc-f432-4b41-9ec6-7406572af528 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:48.904023 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6730e9cc-f432-4b41-9ec6-7406572af528 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:48.918657 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6730e9cc-f432-4b41-9ec6-7406572af528 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:48.919158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6730e9cc-f432-4b41-9ec6-7406572af528 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:48.920650 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6730e9cc-f432-4b41-9ec6-7406572af528 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:48.922564 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6730e9cc-f432-4b41-9ec6-7406572af528 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:49.100363 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6730e9cc-f432-4b41-9ec6-7406572af528 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:49.109149 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6730e9cc-f432-4b41-9ec6-7406572af528 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.217383 Aug 04 10:33:49.110283 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 470/985] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:48 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:49.122504 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-a6d0cbfe-66f5-46ac-93da-2406f4c60acf tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:49.123376 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-a6d0cbfe-66f5-46ac-93da-2406f4c60acf tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:49.136005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6d0cbfe-66f5-46ac-93da-2406f4c60acf tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:49.136005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6d0cbfe-66f5-46ac-93da-2406f4c60acf tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:49.136005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6d0cbfe-66f5-46ac-93da-2406f4c60acf tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:49.136005 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-a6d0cbfe-66f5-46ac-93da-2406f4c60acf tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:49.286635 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-a6d0cbfe-66f5-46ac-93da-2406f4c60acf tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:49.294968 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-a6d0cbfe-66f5-46ac-93da-2406f4c60acf tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.176045 Aug 04 10:33:49.295393 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 516/986] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:49 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:50.131221 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-907058af-4a09-4786-bce3-fe064ff5aa86 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:50.131915 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-907058af-4a09-4786-bce3-fe064ff5aa86 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:50.138808 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-907058af-4a09-4786-bce3-fe064ff5aa86 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:50.139364 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-907058af-4a09-4786-bce3-fe064ff5aa86 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:50.140231 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-907058af-4a09-4786-bce3-fe064ff5aa86 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:50.140728 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-907058af-4a09-4786-bce3-fe064ff5aa86 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:50.274137 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-907058af-4a09-4786-bce3-fe064ff5aa86 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:50.281826 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-907058af-4a09-4786-bce3-fe064ff5aa86 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.154911 Aug 04 10:33:50.282386 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 471/987] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:50 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:50.316804 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-49474cce-f9b5-424b-9690-ad0e05fd55a9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:50.317428 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-49474cce-f9b5-424b-9690-ad0e05fd55a9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:50.324061 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49474cce-f9b5-424b-9690-ad0e05fd55a9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:50.324508 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49474cce-f9b5-424b-9690-ad0e05fd55a9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:50.325301 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49474cce-f9b5-424b-9690-ad0e05fd55a9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:50.325733 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49474cce-f9b5-424b-9690-ad0e05fd55a9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:50.466124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-49474cce-f9b5-424b-9690-ad0e05fd55a9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:50.473919 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-49474cce-f9b5-424b-9690-ad0e05fd55a9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.161048 Aug 04 10:33:50.474515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 517/988] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:50 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:51.302980 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-685ce8b5-1885-400e-838b-59ab693def00 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:51.303589 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-685ce8b5-1885-400e-838b-59ab693def00 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:51.311049 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-685ce8b5-1885-400e-838b-59ab693def00 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:51.311500 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-685ce8b5-1885-400e-838b-59ab693def00 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:51.312424 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-685ce8b5-1885-400e-838b-59ab693def00 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:51.312977 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-685ce8b5-1885-400e-838b-59ab693def00 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:51.450458 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-685ce8b5-1885-400e-838b-59ab693def00 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:51.458159 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-685ce8b5-1885-400e-838b-59ab693def00 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.159016 Aug 04 10:33:51.459109 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 472/989] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:51 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:51.494756 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2890a18f-ee71-4cb5-b822-e6995a2ba26e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:51.496298 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2890a18f-ee71-4cb5-b822-e6995a2ba26e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:51.503313 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2890a18f-ee71-4cb5-b822-e6995a2ba26e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:51.503785 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2890a18f-ee71-4cb5-b822-e6995a2ba26e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:51.504662 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2890a18f-ee71-4cb5-b822-e6995a2ba26e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:51.505172 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2890a18f-ee71-4cb5-b822-e6995a2ba26e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:51.873662 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2890a18f-ee71-4cb5-b822-e6995a2ba26e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:51.881954 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2890a18f-ee71-4cb5-b822-e6995a2ba26e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.391067 Aug 04 10:33:51.882874 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 518/990] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:51 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:52.479623 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5354974f-03ae-4efe-9faa-256d9bd9ab87 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:52.480365 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5354974f-03ae-4efe-9faa-256d9bd9ab87 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:52.487020 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5354974f-03ae-4efe-9faa-256d9bd9ab87 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:52.487551 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5354974f-03ae-4efe-9faa-256d9bd9ab87 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:52.488441 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5354974f-03ae-4efe-9faa-256d9bd9ab87 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:52.488963 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5354974f-03ae-4efe-9faa-256d9bd9ab87 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:52.634900 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5354974f-03ae-4efe-9faa-256d9bd9ab87 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:52.643470 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5354974f-03ae-4efe-9faa-256d9bd9ab87 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.167590 Aug 04 10:33:52.644090 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 473/991] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:52 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:52.904732 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-61581e6e-8039-459b-af19-fb3fef5a99a5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:52.905279 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-61581e6e-8039-459b-af19-fb3fef5a99a5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:52.912022 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61581e6e-8039-459b-af19-fb3fef5a99a5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:52.912487 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61581e6e-8039-459b-af19-fb3fef5a99a5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:52.913259 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61581e6e-8039-459b-af19-fb3fef5a99a5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:52.913696 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-61581e6e-8039-459b-af19-fb3fef5a99a5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:53.050574 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-61581e6e-8039-459b-af19-fb3fef5a99a5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:53.058383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-61581e6e-8039-459b-af19-fb3fef5a99a5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.158443 Aug 04 10:33:53.058945 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 519/992] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:52 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:53.668656 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-acaf7927-f84e-4380-8bef-5a02103181ca tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:53.669942 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-acaf7927-f84e-4380-8bef-5a02103181ca tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:53.677703 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-acaf7927-f84e-4380-8bef-5a02103181ca tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:53.678244 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-acaf7927-f84e-4380-8bef-5a02103181ca tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:53.679574 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-acaf7927-f84e-4380-8bef-5a02103181ca tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:53.680116 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-acaf7927-f84e-4380-8bef-5a02103181ca tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:53.825201 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-acaf7927-f84e-4380-8bef-5a02103181ca tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:53.836235 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-acaf7927-f84e-4380-8bef-5a02103181ca tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.171248 Aug 04 10:33:53.836934 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 474/993] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:53 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:54.082900 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-07be7d68-afd1-4ee6-b1e1-34ea24652790 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:54.083497 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-07be7d68-afd1-4ee6-b1e1-34ea24652790 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:54.090507 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-07be7d68-afd1-4ee6-b1e1-34ea24652790 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:54.091687 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-07be7d68-afd1-4ee6-b1e1-34ea24652790 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:54.092623 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-07be7d68-afd1-4ee6-b1e1-34ea24652790 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:54.093064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-07be7d68-afd1-4ee6-b1e1-34ea24652790 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:54.280517 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-07be7d68-afd1-4ee6-b1e1-34ea24652790 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:54.299672 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-07be7d68-afd1-4ee6-b1e1-34ea24652790 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.220683 Aug 04 10:33:54.314676 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 520/994] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:54 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:54.857721 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6ab6353f-03bd-4b4d-9c06-a78632ebedb2 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:54.859107 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6ab6353f-03bd-4b4d-9c06-a78632ebedb2 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:54.866170 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ab6353f-03bd-4b4d-9c06-a78632ebedb2 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:54.866625 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ab6353f-03bd-4b4d-9c06-a78632ebedb2 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:54.867395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ab6353f-03bd-4b4d-9c06-a78632ebedb2 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:54.867836 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6ab6353f-03bd-4b4d-9c06-a78632ebedb2 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:55.012042 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6ab6353f-03bd-4b4d-9c06-a78632ebedb2 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:55.025029 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6ab6353f-03bd-4b4d-9c06-a78632ebedb2 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.171350 Aug 04 10:33:55.038980 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 475/995] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:54 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:55.321950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-716a0c96-a674-47d8-b8cb-2141cf7737ce tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:55.322554 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-716a0c96-a674-47d8-b8cb-2141cf7737ce tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:55.328411 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=14 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:55.331006 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-716a0c96-a674-47d8-b8cb-2141cf7737ce tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:55.331458 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-716a0c96-a674-47d8-b8cb-2141cf7737ce tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:55.332276 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-716a0c96-a674-47d8-b8cb-2141cf7737ce tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:55.332721 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-716a0c96-a674-47d8-b8cb-2141cf7737ce tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:55.473515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-716a0c96-a674-47d8-b8cb-2141cf7737ce tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:55.481124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-716a0c96-a674-47d8-b8cb-2141cf7737ce tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.163482 Aug 04 10:33:55.481716 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 521/996] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:55 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:56.051082 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f8b764bc-4fe3-48ca-a242-b69bd0e73cd5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:56.051879 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f8b764bc-4fe3-48ca-a242-b69bd0e73cd5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:56.053917 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:56.054970 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=12 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:56.062944 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f8b764bc-4fe3-48ca-a242-b69bd0e73cd5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:56.063396 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f8b764bc-4fe3-48ca-a242-b69bd0e73cd5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:56.064237 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f8b764bc-4fe3-48ca-a242-b69bd0e73cd5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:56.064677 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f8b764bc-4fe3-48ca-a242-b69bd0e73cd5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:56.204909 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f8b764bc-4fe3-48ca-a242-b69bd0e73cd5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:56.212844 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f8b764bc-4fe3-48ca-a242-b69bd0e73cd5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.170485 Aug 04 10:33:56.213647 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 476/997] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:56 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:56.502480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-72454e1b-f4a8-407a-b7b1-2a6ea6d3758b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:56.503147 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-72454e1b-f4a8-407a-b7b1-2a6ea6d3758b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:56.509807 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-72454e1b-f4a8-407a-b7b1-2a6ea6d3758b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:56.510324 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-72454e1b-f4a8-407a-b7b1-2a6ea6d3758b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:56.511098 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-72454e1b-f4a8-407a-b7b1-2a6ea6d3758b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:56.511529 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-72454e1b-f4a8-407a-b7b1-2a6ea6d3758b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:56.653974 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-72454e1b-f4a8-407a-b7b1-2a6ea6d3758b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:56.662252 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-72454e1b-f4a8-407a-b7b1-2a6ea6d3758b tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.163640 Aug 04 10:33:56.676741 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 522/998] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:56 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:57.234424 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0519cedf-cb7f-4b8e-8acd-f59558b14094 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:57.235031 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0519cedf-cb7f-4b8e-8acd-f59558b14094 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:57.241519 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0519cedf-cb7f-4b8e-8acd-f59558b14094 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:57.241968 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0519cedf-cb7f-4b8e-8acd-f59558b14094 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:57.242730 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0519cedf-cb7f-4b8e-8acd-f59558b14094 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:57.243165 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0519cedf-cb7f-4b8e-8acd-f59558b14094 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:57.377823 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0519cedf-cb7f-4b8e-8acd-f59558b14094 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:57.385292 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0519cedf-cb7f-4b8e-8acd-f59558b14094 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.154711 Aug 04 10:33:57.385865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 477/999] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:57 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:57.684385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-03a8145c-f9f1-4fbe-a9b5-ba237edb6465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:57.684947 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-03a8145c-f9f1-4fbe-a9b5-ba237edb6465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:57.691508 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-03a8145c-f9f1-4fbe-a9b5-ba237edb6465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:57.691947 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-03a8145c-f9f1-4fbe-a9b5-ba237edb6465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:57.692731 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-03a8145c-f9f1-4fbe-a9b5-ba237edb6465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:57.693163 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-03a8145c-f9f1-4fbe-a9b5-ba237edb6465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:57.826152 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-03a8145c-f9f1-4fbe-a9b5-ba237edb6465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:57.833534 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-03a8145c-f9f1-4fbe-a9b5-ba237edb6465 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.153141 Aug 04 10:33:57.834096 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 523/1000] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:57 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:58.406748 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-690ed2f0-3150-44e5-bbd3-08672e4d12d5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:58.407368 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-690ed2f0-3150-44e5-bbd3-08672e4d12d5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:58.414139 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-690ed2f0-3150-44e5-bbd3-08672e4d12d5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:58.414576 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-690ed2f0-3150-44e5-bbd3-08672e4d12d5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:58.415341 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-690ed2f0-3150-44e5-bbd3-08672e4d12d5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:58.415774 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-690ed2f0-3150-44e5-bbd3-08672e4d12d5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:58.541919 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-690ed2f0-3150-44e5-bbd3-08672e4d12d5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:58.550286 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-690ed2f0-3150-44e5-bbd3-08672e4d12d5 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.147517 Aug 04 10:33:58.551007 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 478/1001] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:58 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:58.854853 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bf81b7d4-0704-4a17-a551-22f3193e2f65 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:58.855394 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bf81b7d4-0704-4a17-a551-22f3193e2f65 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:58.862466 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf81b7d4-0704-4a17-a551-22f3193e2f65 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:58.862909 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf81b7d4-0704-4a17-a551-22f3193e2f65 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:58.863681 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf81b7d4-0704-4a17-a551-22f3193e2f65 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:58.864145 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bf81b7d4-0704-4a17-a551-22f3193e2f65 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:59.008998 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bf81b7d4-0704-4a17-a551-22f3193e2f65 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:59.016984 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bf81b7d4-0704-4a17-a551-22f3193e2f65 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.166154 Aug 04 10:33:59.017550 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 524/1002] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:58 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:59.117389 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-d4f7f8ad-af44-4149-a53c-0a38a85fcd78 req-4b583db7-e593-435a-b882-ca26e6263343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b5f22b-45ce-40fe-8573-fcd858e5efed", "tag": "212d642e-6e42-4971-b584-f811951bcb45"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:59.127271 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-d4f7f8ad-af44-4149-a53c-0a38a85fcd78 req-4b583db7-e593-435a-b882-ca26e6263343 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:59.127707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-d4f7f8ad-af44-4149-a53c-0a38a85fcd78 req-4b583db7-e593-435a-b882-ca26e6263343 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:59.148124 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-d4f7f8ad-af44-4149-a53c-0a38a85fcd78 req-4b583db7-e593-435a-b882-ca26e6263343 service nova] Creating event network-changed:212d642e-6e42-4971-b584-f811951bcb45 for instance d4b5f22b-45ce-40fe-8573-fcd858e5efed on hv-cinder-82660 Aug 04 10:33:59.152979 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-d4f7f8ad-af44-4149-a53c-0a38a85fcd78 req-4b583db7-e593-435a-b882-ca26e6263343 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039615 Aug 04 10:33:59.153575 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 479/1003] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:33:59.572971 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-e0d7ae97-dbff-490e-be62-8cf3f52b0f1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:59.574268 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-e0d7ae97-dbff-490e-be62-8cf3f52b0f1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:59.581951 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0d7ae97-dbff-490e-be62-8cf3f52b0f1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:59.582773 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0d7ae97-dbff-490e-be62-8cf3f52b0f1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:59.583558 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0d7ae97-dbff-490e-be62-8cf3f52b0f1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:59.584017 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-e0d7ae97-dbff-490e-be62-8cf3f52b0f1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:59.715021 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-e0d7ae97-dbff-490e-be62-8cf3f52b0f1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:59.722454 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-e0d7ae97-dbff-490e-be62-8cf3f52b0f1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.154141 Aug 04 10:33:59.723020 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 525/1004] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:33:59 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:00.039315 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-3341ebac-2240-4261-a5fe-499ab225e5b2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:00.040028 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-3341ebac-2240-4261-a5fe-499ab225e5b2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:00.046734 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3341ebac-2240-4261-a5fe-499ab225e5b2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:00.047179 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3341ebac-2240-4261-a5fe-499ab225e5b2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:00.047936 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3341ebac-2240-4261-a5fe-499ab225e5b2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:00.048388 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-3341ebac-2240-4261-a5fe-499ab225e5b2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:00.182675 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-3341ebac-2240-4261-a5fe-499ab225e5b2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:00.190691 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-3341ebac-2240-4261-a5fe-499ab225e5b2 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.156122 Aug 04 10:34:00.191260 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 480/1005] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:00 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:00.742510 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-fed76871-4672-445b-82b6-c4c5cb9ed775 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:00.743103 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-fed76871-4672-445b-82b6-c4c5cb9ed775 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:00.749719 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fed76871-4672-445b-82b6-c4c5cb9ed775 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:00.750397 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fed76871-4672-445b-82b6-c4c5cb9ed775 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:00.751156 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fed76871-4672-445b-82b6-c4c5cb9ed775 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:00.751583 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-fed76871-4672-445b-82b6-c4c5cb9ed775 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:00.902803 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-fed76871-4672-445b-82b6-c4c5cb9ed775 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:00.906847 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=100 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:00.912081 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-fed76871-4672-445b-82b6-c4c5cb9ed775 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.173311 Aug 04 10:34:00.912657 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 526/1006] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:00 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:01.210362 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0d876cf8-e2f3-479a-9382-13f6f039ffe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:01.210907 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0d876cf8-e2f3-479a-9382-13f6f039ffe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:01.217464 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0d876cf8-e2f3-479a-9382-13f6f039ffe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:01.217910 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0d876cf8-e2f3-479a-9382-13f6f039ffe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:01.218660 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0d876cf8-e2f3-479a-9382-13f6f039ffe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:01.219091 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0d876cf8-e2f3-479a-9382-13f6f039ffe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:01.348333 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0d876cf8-e2f3-479a-9382-13f6f039ffe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:01.351903 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=100 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:01.356871 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0d876cf8-e2f3-479a-9382-13f6f039ffe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.150486 Aug 04 10:34:01.357426 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 481/1007] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:01 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:01.932739 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d88ca51b-55e6-4628-8c18-0e3e83042d8b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:01.933342 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d88ca51b-55e6-4628-8c18-0e3e83042d8b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:01.940412 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d88ca51b-55e6-4628-8c18-0e3e83042d8b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:01.940854 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d88ca51b-55e6-4628-8c18-0e3e83042d8b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:01.941606 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d88ca51b-55e6-4628-8c18-0e3e83042d8b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:01.942035 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d88ca51b-55e6-4628-8c18-0e3e83042d8b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:02.074411 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d88ca51b-55e6-4628-8c18-0e3e83042d8b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:02.082836 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d88ca51b-55e6-4628-8c18-0e3e83042d8b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.154147 Aug 04 10:34:02.083787 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 527/1008] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:01 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:02.377987 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8c6c300a-2a54-4032-87e8-0dcd68485cb8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:02.378641 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8c6c300a-2a54-4032-87e8-0dcd68485cb8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:02.385219 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8c6c300a-2a54-4032-87e8-0dcd68485cb8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:02.385666 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8c6c300a-2a54-4032-87e8-0dcd68485cb8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:02.386427 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8c6c300a-2a54-4032-87e8-0dcd68485cb8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:02.386861 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8c6c300a-2a54-4032-87e8-0dcd68485cb8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:02.514547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8c6c300a-2a54-4032-87e8-0dcd68485cb8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:02.521969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8c6c300a-2a54-4032-87e8-0dcd68485cb8 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.147810 Aug 04 10:34:02.522527 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 482/1009] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:02 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:03.102696 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-162cd49c-c609-4fdf-9aa8-9aefe7c92e9e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:03.103303 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-162cd49c-c609-4fdf-9aa8-9aefe7c92e9e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:03.105671 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:03.112225 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-162cd49c-c609-4fdf-9aa8-9aefe7c92e9e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:03.112682 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-162cd49c-c609-4fdf-9aa8-9aefe7c92e9e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:03.113456 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-162cd49c-c609-4fdf-9aa8-9aefe7c92e9e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:03.113894 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-162cd49c-c609-4fdf-9aa8-9aefe7c92e9e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:03.243591 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-162cd49c-c609-4fdf-9aa8-9aefe7c92e9e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:03.251085 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-162cd49c-c609-4fdf-9aa8-9aefe7c92e9e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.152247 Aug 04 10:34:03.251685 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 528/1010] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:03 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:03.542448 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-530c34d3-33c2-408a-bf8c-cafb9b86b77e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:03.543052 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-530c34d3-33c2-408a-bf8c-cafb9b86b77e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:03.549525 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-530c34d3-33c2-408a-bf8c-cafb9b86b77e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:03.549971 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-530c34d3-33c2-408a-bf8c-cafb9b86b77e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:03.550722 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-530c34d3-33c2-408a-bf8c-cafb9b86b77e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:03.551153 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-530c34d3-33c2-408a-bf8c-cafb9b86b77e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:03.679905 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-530c34d3-33c2-408a-bf8c-cafb9b86b77e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:03.687902 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-530c34d3-33c2-408a-bf8c-cafb9b86b77e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.149307 Aug 04 10:34:03.688486 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 483/1011] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:03 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:04.271287 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-408974de-463b-44ea-9100-cfb49f139b3a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:04.271927 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-408974de-463b-44ea-9100-cfb49f139b3a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:04.278241 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-408974de-463b-44ea-9100-cfb49f139b3a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:04.278694 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-408974de-463b-44ea-9100-cfb49f139b3a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:04.279983 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-408974de-463b-44ea-9100-cfb49f139b3a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:04.280425 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-408974de-463b-44ea-9100-cfb49f139b3a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:04.407451 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-408974de-463b-44ea-9100-cfb49f139b3a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:04.414833 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-408974de-463b-44ea-9100-cfb49f139b3a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.147564 Aug 04 10:34:04.415396 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 529/1012] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:04 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:04.708351 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-70c61ddc-cbb9-45b6-b464-d8606bf3783c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:04.708954 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-70c61ddc-cbb9-45b6-b464-d8606bf3783c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:04.715485 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-70c61ddc-cbb9-45b6-b464-d8606bf3783c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:04.715927 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-70c61ddc-cbb9-45b6-b464-d8606bf3783c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:04.716709 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-70c61ddc-cbb9-45b6-b464-d8606bf3783c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:04.717707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-70c61ddc-cbb9-45b6-b464-d8606bf3783c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:04.849039 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-70c61ddc-cbb9-45b6-b464-d8606bf3783c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:04.856581 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-70c61ddc-cbb9-45b6-b464-d8606bf3783c tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.152127 Aug 04 10:34:04.857150 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 484/1013] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:04 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:05.436885 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-075cebee-81c1-4e15-806f-b1f76eb16dda tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:05.437501 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-075cebee-81c1-4e15-806f-b1f76eb16dda tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:05.444290 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-075cebee-81c1-4e15-806f-b1f76eb16dda tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:05.444747 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-075cebee-81c1-4e15-806f-b1f76eb16dda tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:05.445514 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-075cebee-81c1-4e15-806f-b1f76eb16dda tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:05.445955 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-075cebee-81c1-4e15-806f-b1f76eb16dda tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:05.574970 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-075cebee-81c1-4e15-806f-b1f76eb16dda tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:05.582439 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-075cebee-81c1-4e15-806f-b1f76eb16dda tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.150191 Aug 04 10:34:05.582997 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 530/1014] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:05 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:05.876249 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0759c935-f2ff-4e9b-b816-ccc3e0c00137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:05.876840 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-0759c935-f2ff-4e9b-b816-ccc3e0c00137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:05.879156 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:05.885680 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0759c935-f2ff-4e9b-b816-ccc3e0c00137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:05.886292 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0759c935-f2ff-4e9b-b816-ccc3e0c00137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:05.887097 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0759c935-f2ff-4e9b-b816-ccc3e0c00137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:05.887655 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-0759c935-f2ff-4e9b-b816-ccc3e0c00137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:05.922480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-286c19a6-c946-4471-bb0b-8bf29fe470f9 req-658d900e-93ae-4e56-add7-69060d008535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b5f22b-45ce-40fe-8573-fcd858e5efed", "name": "network-vif-plugged", "status": "completed", "tag": "212d642e-6e42-4971-b584-f811951bcb45"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:05.934289 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-286c19a6-c946-4471-bb0b-8bf29fe470f9 req-658d900e-93ae-4e56-add7-69060d008535 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:05.934825 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-286c19a6-c946-4471-bb0b-8bf29fe470f9 req-658d900e-93ae-4e56-add7-69060d008535 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:05.948162 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-286c19a6-c946-4471-bb0b-8bf29fe470f9 req-658d900e-93ae-4e56-add7-69060d008535 service nova] Creating event network-vif-plugged:212d642e-6e42-4971-b584-f811951bcb45 for instance d4b5f22b-45ce-40fe-8573-fcd858e5efed on hv-cinder-82660 Aug 04 10:34:05.953889 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-286c19a6-c946-4471-bb0b-8bf29fe470f9 req-658d900e-93ae-4e56-add7-69060d008535 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035656 Aug 04 10:34:05.954525 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 531/1015] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:34:06.029804 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-0759c935-f2ff-4e9b-b816-ccc3e0c00137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:06.038200 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0759c935-f2ff-4e9b-b816-ccc3e0c00137 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.165798 Aug 04 10:34:06.038766 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 485/1016] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:05 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:06.602976 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-d0162559-b619-4cc5-a5ed-9da11983915c tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:06.603704 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-d0162559-b619-4cc5-a5ed-9da11983915c tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:06.610717 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d0162559-b619-4cc5-a5ed-9da11983915c tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:06.611165 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d0162559-b619-4cc5-a5ed-9da11983915c tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:06.611929 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d0162559-b619-4cc5-a5ed-9da11983915c tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:06.612385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-d0162559-b619-4cc5-a5ed-9da11983915c tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:06.742578 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-d0162559-b619-4cc5-a5ed-9da11983915c tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:06.750849 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-d0162559-b619-4cc5-a5ed-9da11983915c tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.151958 Aug 04 10:34:06.751412 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 532/1017] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:06 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:07.058982 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-557871fa-1b5b-4648-a6b4-e72828168814 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:07.059590 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-557871fa-1b5b-4648-a6b4-e72828168814 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:07.066871 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-557871fa-1b5b-4648-a6b4-e72828168814 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:07.067313 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-557871fa-1b5b-4648-a6b4-e72828168814 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:07.068088 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-557871fa-1b5b-4648-a6b4-e72828168814 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:07.068519 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-557871fa-1b5b-4648-a6b4-e72828168814 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:07.202459 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-557871fa-1b5b-4648-a6b4-e72828168814 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:07.209998 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-557871fa-1b5b-4648-a6b4-e72828168814 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.154915 Aug 04 10:34:07.210567 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 486/1018] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:07 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:07.772580 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-daef128a-31cb-4af9-8bcc-a5c5219cefcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:07.773193 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-daef128a-31cb-4af9-8bcc-a5c5219cefcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:07.779681 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-daef128a-31cb-4af9-8bcc-a5c5219cefcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:07.780168 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-daef128a-31cb-4af9-8bcc-a5c5219cefcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:07.780934 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-daef128a-31cb-4af9-8bcc-a5c5219cefcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:07.781367 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-daef128a-31cb-4af9-8bcc-a5c5219cefcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:07.919519 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-daef128a-31cb-4af9-8bcc-a5c5219cefcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:07.926919 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-daef128a-31cb-4af9-8bcc-a5c5219cefcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.158242 Aug 04 10:34:07.927478 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 533/1019] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:07 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:08.230886 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-39d7ce30-3d26-49ff-bb53-cb2ea956d702 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:08.231453 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-39d7ce30-3d26-49ff-bb53-cb2ea956d702 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:08.238119 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-39d7ce30-3d26-49ff-bb53-cb2ea956d702 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:08.238566 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-39d7ce30-3d26-49ff-bb53-cb2ea956d702 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:08.239335 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-39d7ce30-3d26-49ff-bb53-cb2ea956d702 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:08.239800 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-39d7ce30-3d26-49ff-bb53-cb2ea956d702 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:08.368086 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-39d7ce30-3d26-49ff-bb53-cb2ea956d702 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:08.375605 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-39d7ce30-3d26-49ff-bb53-cb2ea956d702 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.148762 Aug 04 10:34:08.376233 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 487/1020] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:08 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:08.948256 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3b22c8ca-dad4-40a7-8bc0-15023d968bc8 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:08.948956 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3b22c8ca-dad4-40a7-8bc0-15023d968bc8 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:08.955458 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3b22c8ca-dad4-40a7-8bc0-15023d968bc8 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:08.956090 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3b22c8ca-dad4-40a7-8bc0-15023d968bc8 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:08.956923 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3b22c8ca-dad4-40a7-8bc0-15023d968bc8 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:08.957362 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3b22c8ca-dad4-40a7-8bc0-15023d968bc8 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:09.095509 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3b22c8ca-dad4-40a7-8bc0-15023d968bc8 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:09.105612 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3b22c8ca-dad4-40a7-8bc0-15023d968bc8 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.160040 Aug 04 10:34:09.109339 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 534/1021] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:08 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:09.396626 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-6f37e89c-d68c-4a49-b726-dcc700d96eb6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:09.397771 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-6f37e89c-d68c-4a49-b726-dcc700d96eb6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:09.404310 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6f37e89c-d68c-4a49-b726-dcc700d96eb6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:09.404760 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6f37e89c-d68c-4a49-b726-dcc700d96eb6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:09.406139 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6f37e89c-d68c-4a49-b726-dcc700d96eb6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:09.406762 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-6f37e89c-d68c-4a49-b726-dcc700d96eb6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:09.550228 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-6f37e89c-d68c-4a49-b726-dcc700d96eb6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:09.557845 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-6f37e89c-d68c-4a49-b726-dcc700d96eb6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.165141 Aug 04 10:34:09.558422 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 488/1022] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:09 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:10.132995 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-49f51961-0612-4cd6-bc74-25a7a51beb7e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:10.134275 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-49f51961-0612-4cd6-bc74-25a7a51beb7e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:10.140877 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49f51961-0612-4cd6-bc74-25a7a51beb7e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:10.141441 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49f51961-0612-4cd6-bc74-25a7a51beb7e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:10.142806 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49f51961-0612-4cd6-bc74-25a7a51beb7e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:10.143311 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-49f51961-0612-4cd6-bc74-25a7a51beb7e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:10.279595 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-49f51961-0612-4cd6-bc74-25a7a51beb7e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:10.287013 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-49f51961-0612-4cd6-bc74-25a7a51beb7e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.158810 Aug 04 10:34:10.287574 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 535/1023] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:10 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:10.578823 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e1855a2a-bc26-431b-840a-cf02914f8941 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:10.579394 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e1855a2a-bc26-431b-840a-cf02914f8941 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:10.585980 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e1855a2a-bc26-431b-840a-cf02914f8941 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:10.586433 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e1855a2a-bc26-431b-840a-cf02914f8941 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:10.587209 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e1855a2a-bc26-431b-840a-cf02914f8941 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:10.587648 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e1855a2a-bc26-431b-840a-cf02914f8941 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:10.732727 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e1855a2a-bc26-431b-840a-cf02914f8941 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:10.740926 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e1855a2a-bc26-431b-840a-cf02914f8941 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.166366 Aug 04 10:34:10.741487 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 489/1024] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:10 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:11.307105 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-f977ff48-2825-47b7-906b-c9e3e49c4dcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:11.307743 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-f977ff48-2825-47b7-906b-c9e3e49c4dcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:11.314919 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f977ff48-2825-47b7-906b-c9e3e49c4dcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:11.315432 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f977ff48-2825-47b7-906b-c9e3e49c4dcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:11.316257 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f977ff48-2825-47b7-906b-c9e3e49c4dcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:11.316748 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-f977ff48-2825-47b7-906b-c9e3e49c4dcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:11.452900 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-f977ff48-2825-47b7-906b-c9e3e49c4dcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:11.460977 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-f977ff48-2825-47b7-906b-c9e3e49c4dcf tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1358 microversion: 2.1 time: 0.157926 Aug 04 10:34:11.461596 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 536/1025] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:11 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:11.762107 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1c9bf0d5-59b1-4d9f-bd92-974b27cdd7cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:11.762725 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-1c9bf0d5-59b1-4d9f-bd92-974b27cdd7cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:11.769951 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1c9bf0d5-59b1-4d9f-bd92-974b27cdd7cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:11.770403 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1c9bf0d5-59b1-4d9f-bd92-974b27cdd7cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:11.771212 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1c9bf0d5-59b1-4d9f-bd92-974b27cdd7cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:11.771654 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1c9bf0d5-59b1-4d9f-bd92-974b27cdd7cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:11.930621 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-1c9bf0d5-59b1-4d9f-bd92-974b27cdd7cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:11.940712 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-1c9bf0d5-59b1-4d9f-bd92-974b27cdd7cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.180242 Aug 04 10:34:11.941949 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 490/1026] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:11 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:12.214077 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-7e9884ee-ea47-4c0f-ae86-29cc14a71d48 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:12.216327 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-7e9884ee-ea47-4c0f-ae86-29cc14a71d48 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:12.222240 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7e9884ee-ea47-4c0f-ae86-29cc14a71d48 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.222679 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7e9884ee-ea47-4c0f-ae86-29cc14a71d48 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.223427 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7e9884ee-ea47-4c0f-ae86-29cc14a71d48 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.223852 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-7e9884ee-ea47-4c0f-ae86-29cc14a71d48 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.322208 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-7e9884ee-ea47-4c0f-ae86-29cc14a71d48 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "POST /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9/action" status: 200 len: 62973 microversion: 2.1 time: 0.336957 Aug 04 10:34:12.330735 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 537/1027] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:34:11 2022] POST /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9/action => generated 62973 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:34:12.482387 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1bd6fb3c-a19a-4ef8-859d-675b81e65e2d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:12.482928 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-1bd6fb3c-a19a-4ef8-859d-675b81e65e2d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:12.490282 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1bd6fb3c-a19a-4ef8-859d-675b81e65e2d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.491023 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1bd6fb3c-a19a-4ef8-859d-675b81e65e2d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.491861 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1bd6fb3c-a19a-4ef8-859d-675b81e65e2d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.492609 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1bd6fb3c-a19a-4ef8-859d-675b81e65e2d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.683865 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-1bd6fb3c-a19a-4ef8-859d-675b81e65e2d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:12.696040 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-1bd6fb3c-a19a-4ef8-859d-675b81e65e2d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1548 microversion: 2.1 time: 0.217763 Aug 04 10:34:12.696622 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 491/1028] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:12 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1548 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:12.717275 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5438839b-ca6c-47ea-ab4e-978da1dcc5bd tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:12.717974 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5438839b-ca6c-47ea-ab4e-978da1dcc5bd tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:12.726134 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5438839b-ca6c-47ea-ab4e-978da1dcc5bd tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.727313 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5438839b-ca6c-47ea-ab4e-978da1dcc5bd tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.728454 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5438839b-ca6c-47ea-ab4e-978da1dcc5bd tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.729038 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5438839b-ca6c-47ea-ab4e-978da1dcc5bd tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.919039 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5438839b-ca6c-47ea-ab4e-978da1dcc5bd tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:12.928554 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5438839b-ca6c-47ea-ab4e-978da1dcc5bd tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1548 microversion: 2.1 time: 0.214766 Aug 04 10:34:12.929120 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 538/1029] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:12 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1548 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:12.950341 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-87fc17ba-1df9-4d31-b21c-5b7fa0f5f17f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:12.954887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-87fc17ba-1df9-4d31-b21c-5b7fa0f5f17f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:12.956725 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-87fc17ba-1df9-4d31-b21c-5b7fa0f5f17f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Searching by: {'deleted': False, 'project_id': 'f63d8ac72593445089042fd7c3a31651'} {{(pid=117667) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 10:34:12.961759 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-62dbb0b1-48d7-4bec-ace5-a41eb2ad91cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:12.962380 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-62dbb0b1-48d7-4bec-ace5-a41eb2ad91cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:12.973844 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62dbb0b1-48d7-4bec-ace5-a41eb2ad91cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.974310 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62dbb0b1-48d7-4bec-ace5-a41eb2ad91cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.978122 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-87fc17ba-1df9-4d31-b21c-5b7fa0f5f17f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.978564 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-87fc17ba-1df9-4d31-b21c-5b7fa0f5f17f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.979456 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-87fc17ba-1df9-4d31-b21c-5b7fa0f5f17f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.979901 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-87fc17ba-1df9-4d31-b21c-5b7fa0f5f17f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.988880 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62dbb0b1-48d7-4bec-ace5-a41eb2ad91cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.989305 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-62dbb0b1-48d7-4bec-ace5-a41eb2ad91cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:13.082463 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.multi_cell_list [None req-87fc17ba-1df9-4d31-b21c-5b7fa0f5f17f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117667) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 10:34:13.185388 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-87fc17ba-1df9-4d31-b21c-5b7fa0f5f17f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.239951 Aug 04 10:34:13.185978 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 492/1030] 10.222.0.72 () {58 vars in 1125 bytes} [Thu Aug 4 10:34:12 2022] GET /compute/v2.1/servers => generated 343 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:34:13.204150 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-bc3d529a-5802-4bc9-a45b-f166d31f1d4a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:13.204808 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-bc3d529a-5802-4bc9-a45b-f166d31f1d4a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:13.212355 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bc3d529a-5802-4bc9-a45b-f166d31f1d4a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.213100 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bc3d529a-5802-4bc9-a45b-f166d31f1d4a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:13.214858 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bc3d529a-5802-4bc9-a45b-f166d31f1d4a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.215119 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-bc3d529a-5802-4bc9-a45b-f166d31f1d4a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:13.270454 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-62dbb0b1-48d7-4bec-ace5-a41eb2ad91cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:13.278153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-62dbb0b1-48d7-4bec-ace5-a41eb2ad91cd tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.320371 Aug 04 10:34:13.278721 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 539/1031] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:12 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:13.433856 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-bc3d529a-5802-4bc9-a45b-f166d31f1d4a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:13.450895 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-bc3d529a-5802-4bc9-a45b-f166d31f1d4a tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1548 microversion: 2.1 time: 0.256766 Aug 04 10:34:13.460337 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 493/1032] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:13 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1548 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:13.608396 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0a8dda97-59bb-49bd-843c-7ae061692f89 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:13.608945 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0a8dda97-59bb-49bd-843c-7ae061692f89 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:13.614139 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-5c4256c0-c1f4-4706-a4eb-dfb1f2148689 req-90de9ade-2854-4ed1-9a34-fc869f36de63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e129c5-a1f4-418e-a7c7-8840c88c20e9", "tag": "99b65378-21c4-446f-87b5-bc67e1fde387"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:13.623754 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-5c4256c0-c1f4-4706-a4eb-dfb1f2148689 req-90de9ade-2854-4ed1-9a34-fc869f36de63 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.624484 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-5c4256c0-c1f4-4706-a4eb-dfb1f2148689 req-90de9ade-2854-4ed1-9a34-fc869f36de63 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:13.630952 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a8dda97-59bb-49bd-843c-7ae061692f89 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.631401 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a8dda97-59bb-49bd-843c-7ae061692f89 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:13.633124 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a8dda97-59bb-49bd-843c-7ae061692f89 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.633642 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0a8dda97-59bb-49bd-843c-7ae061692f89 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:13.637994 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-5c4256c0-c1f4-4706-a4eb-dfb1f2148689 req-90de9ade-2854-4ed1-9a34-fc869f36de63 service nova] Creating event network-changed:99b65378-21c4-446f-87b5-bc67e1fde387 for instance 34e129c5-a1f4-418e-a7c7-8840c88c20e9 on hv-cinder-82660 Aug 04 10:34:13.643552 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-5c4256c0-c1f4-4706-a4eb-dfb1f2148689 req-90de9ade-2854-4ed1-9a34-fc869f36de63 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035304 Aug 04 10:34:13.644746 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 494/1033] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:34:13.665349 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0a8dda97-59bb-49bd-843c-7ae061692f89 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:34:13.758054 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0a8dda97-59bb-49bd-843c-7ae061692f89 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "DELETE /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 204 len: 0 microversion: 2.1 time: 0.153565 Aug 04 10:34:13.758652 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 540/1034] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:34:13 2022] DELETE /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:34:13.767589 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-9120c7a4-b4c4-4a6d-b48c-37ccf1ed9816 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:13.768436 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-9120c7a4-b4c4-4a6d-b48c-37ccf1ed9816 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:13.777400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9120c7a4-b4c4-4a6d-b48c-37ccf1ed9816 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.778214 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9120c7a4-b4c4-4a6d-b48c-37ccf1ed9816 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:13.779207 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9120c7a4-b4c4-4a6d-b48c-37ccf1ed9816 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.779858 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-9120c7a4-b4c4-4a6d-b48c-37ccf1ed9816 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:14.009371 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-9120c7a4-b4c4-4a6d-b48c-37ccf1ed9816 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:14.017368 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-9120c7a4-b4c4-4a6d-b48c-37ccf1ed9816 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1570 microversion: 2.1 time: 0.253911 Aug 04 10:34:14.020027 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 495/1035] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:13 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1570 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:14.063298 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-1290985c-c86c-4363-949c-d46e90ccf1ee req-07063ab4-cf38-412f-9a21-5e54bb22ec66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b53386c-d4ab-449c-a60a-bcb1aaff42ea", "name": "network-vif-plugged", "status": "completed", "tag": "f73efd39-7084-4080-b354-dd511042f3ee"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:14.074079 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-1290985c-c86c-4363-949c-d46e90ccf1ee req-07063ab4-cf38-412f-9a21-5e54bb22ec66 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:14.074842 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-1290985c-c86c-4363-949c-d46e90ccf1ee req-07063ab4-cf38-412f-9a21-5e54bb22ec66 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:14.087225 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-1290985c-c86c-4363-949c-d46e90ccf1ee req-07063ab4-cf38-412f-9a21-5e54bb22ec66 service nova] Creating event network-vif-plugged:f73efd39-7084-4080-b354-dd511042f3ee for instance 5b53386c-d4ab-449c-a60a-bcb1aaff42ea on hv-cinder-82660 Aug 04 10:34:14.092253 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-1290985c-c86c-4363-949c-d46e90ccf1ee req-07063ab4-cf38-412f-9a21-5e54bb22ec66 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033674 Aug 04 10:34:14.093036 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 541/1036] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:34:14.298685 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c23588a5-13f6-49bc-9f44-18c5451f33ed tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:14.299301 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c23588a5-13f6-49bc-9f44-18c5451f33ed tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:14.305694 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c23588a5-13f6-49bc-9f44-18c5451f33ed tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:14.306150 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c23588a5-13f6-49bc-9f44-18c5451f33ed tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:14.306944 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c23588a5-13f6-49bc-9f44-18c5451f33ed tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:14.307378 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c23588a5-13f6-49bc-9f44-18c5451f33ed tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:14.443337 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-c23588a5-13f6-49bc-9f44-18c5451f33ed tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:14.451220 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c23588a5-13f6-49bc-9f44-18c5451f33ed tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.156283 Aug 04 10:34:14.451949 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 496/1037] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:14 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:15.039435 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-28b19fb8-1c21-4837-b13a-99ce31bc78d0 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:15.040472 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-28b19fb8-1c21-4837-b13a-99ce31bc78d0 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:15.047000 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-28b19fb8-1c21-4837-b13a-99ce31bc78d0 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:15.047477 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-28b19fb8-1c21-4837-b13a-99ce31bc78d0 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:15.048866 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-28b19fb8-1c21-4837-b13a-99ce31bc78d0 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:15.049306 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-28b19fb8-1c21-4837-b13a-99ce31bc78d0 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:15.107497 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-210615e9-fb01-4483-90bd-50e423f91fed tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c66668f-9a07-4929-8949-53ad26b75f50"}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:15.111507 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-210615e9-fb01-4483-90bd-50e423f91fed tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:15.117963 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-210615e9-fb01-4483-90bd-50e423f91fed tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:15.118407 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-210615e9-fb01-4483-90bd-50e423f91fed tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:15.119171 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-210615e9-fb01-4483-90bd-50e423f91fed tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:15.119601 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-210615e9-fb01-4483-90bd-50e423f91fed tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:15.186275 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-28b19fb8-1c21-4837-b13a-99ce31bc78d0 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:15.194423 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-28b19fb8-1c21-4837-b13a-99ce31bc78d0 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1570 microversion: 2.1 time: 0.159291 Aug 04 10:34:15.194984 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 542/1038] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:15 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:15.476680 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-8a2706b0-e31d-492b-a754-49140eb29f4e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:15.478114 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-8a2706b0-e31d-492b-a754-49140eb29f4e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:15.490399 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a2706b0-e31d-492b-a754-49140eb29f4e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:15.491043 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a2706b0-e31d-492b-a754-49140eb29f4e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:15.492340 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a2706b0-e31d-492b-a754-49140eb29f4e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:15.493337 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-8a2706b0-e31d-492b-a754-49140eb29f4e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:15.529290 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:15.660886 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-8a2706b0-e31d-492b-a754-49140eb29f4e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:15.668385 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-8a2706b0-e31d-492b-a754-49140eb29f4e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.199283 Aug 04 10:34:15.668946 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 543/1039] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:15 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:15.821496 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:15.847208 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-210615e9-fb01-4483-90bd-50e423f91fed tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "POST /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.743556 Aug 04 10:34:15.847817 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 497/1040] 10.222.0.72 () {60 vars in 1323 bytes} [Thu Aug 4 10:34:15 2022] POST /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/os-volume_attachments => generated 194 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:34:16.217700 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9469f437-652e-4d15-b36f-975a4ed58d24 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:16.219328 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9469f437-652e-4d15-b36f-975a4ed58d24 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:16.227075 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9469f437-652e-4d15-b36f-975a4ed58d24 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:16.227577 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9469f437-652e-4d15-b36f-975a4ed58d24 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:16.228418 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9469f437-652e-4d15-b36f-975a4ed58d24 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:16.228855 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9469f437-652e-4d15-b36f-975a4ed58d24 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:16.691878 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-8a64aa02-d805-41ce-a298-39205b39cbe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:16.693195 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-8a64aa02-d805-41ce-a298-39205b39cbe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:16.699499 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8a64aa02-d805-41ce-a298-39205b39cbe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:16.700195 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8a64aa02-d805-41ce-a298-39205b39cbe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:16.700972 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8a64aa02-d805-41ce-a298-39205b39cbe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:16.701404 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-8a64aa02-d805-41ce-a298-39205b39cbe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:16.749845 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9469f437-652e-4d15-b36f-975a4ed58d24 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:16.762112 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9469f437-652e-4d15-b36f-975a4ed58d24 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1570 microversion: 2.1 time: 0.549067 Aug 04 10:34:16.763458 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 544/1041] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:16 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1570 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:16.895214 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-8a64aa02-d805-41ce-a298-39205b39cbe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:16.902746 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-8a64aa02-d805-41ce-a298-39205b39cbe0 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1266 microversion: 2.1 time: 0.216198 Aug 04 10:34:16.903375 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 498/1042] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:16 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:17.121639 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-e907ec0d-4af5-49d0-bab8-1ae7337c4445 req-916bfcd4-2fa0-46a6-a66e-3d9392043c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e129c5-a1f4-418e-a7c7-8840c88c20e9", "name": "network-vif-deleted", "tag": "99b65378-21c4-446f-87b5-bc67e1fde387"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:17.134028 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-e907ec0d-4af5-49d0-bab8-1ae7337c4445 req-916bfcd4-2fa0-46a6-a66e-3d9392043c26 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:17.135015 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-e907ec0d-4af5-49d0-bab8-1ae7337c4445 req-916bfcd4-2fa0-46a6-a66e-3d9392043c26 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:17.148546 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-e907ec0d-4af5-49d0-bab8-1ae7337c4445 req-916bfcd4-2fa0-46a6-a66e-3d9392043c26 service nova] Creating event network-vif-deleted:99b65378-21c4-446f-87b5-bc67e1fde387 for instance 34e129c5-a1f4-418e-a7c7-8840c88c20e9 on hv-cinder-82660 Aug 04 10:34:17.153663 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-e907ec0d-4af5-49d0-bab8-1ae7337c4445 req-916bfcd4-2fa0-46a6-a66e-3d9392043c26 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039120 Aug 04 10:34:17.154582 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 545/1043] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:34:17.785710 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-fbe71a5a-60cb-4333-9e7a-3bb90abb35f5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:17.786927 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-fbe71a5a-60cb-4333-9e7a-3bb90abb35f5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:17.795134 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fbe71a5a-60cb-4333-9e7a-3bb90abb35f5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:17.795688 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fbe71a5a-60cb-4333-9e7a-3bb90abb35f5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:17.796580 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fbe71a5a-60cb-4333-9e7a-3bb90abb35f5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:17.797304 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fbe71a5a-60cb-4333-9e7a-3bb90abb35f5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:17.864048 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-fbe71a5a-60cb-4333-9e7a-3bb90abb35f5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ecb46bae9e4e369416d138203abe6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5084c2b61ad2427d91e0fc85392aee14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:17.871939 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-fbe71a5a-60cb-4333-9e7a-3bb90abb35f5 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 200 len: 1220 microversion: 2.1 time: 0.092348 Aug 04 10:34:17.872630 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 499/1044] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:17 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:17.926502 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-bd93887f-0c59-424c-9c44-fa5f0bc73cc5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:17.927292 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-bd93887f-0c59-424c-9c44-fa5f0bc73cc5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:17.935789 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bd93887f-0c59-424c-9c44-fa5f0bc73cc5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:17.936261 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bd93887f-0c59-424c-9c44-fa5f0bc73cc5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:17.937121 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bd93887f-0c59-424c-9c44-fa5f0bc73cc5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:17.937554 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-bd93887f-0c59-424c-9c44-fa5f0bc73cc5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:18.084369 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-bd93887f-0c59-424c-9c44-fa5f0bc73cc5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:18.095021 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-bd93887f-0c59-424c-9c44-fa5f0bc73cc5 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1454 microversion: 2.1 time: 0.173364 Aug 04 10:34:18.095847 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 546/1045] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:17 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:18.117489 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f4eae8cd-6678-4d8f-82bf-23dbf7045ee9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:18.117605 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f4eae8cd-6678-4d8f-82bf-23dbf7045ee9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:18.124596 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f4eae8cd-6678-4d8f-82bf-23dbf7045ee9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:18.125130 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f4eae8cd-6678-4d8f-82bf-23dbf7045ee9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:18.126087 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f4eae8cd-6678-4d8f-82bf-23dbf7045ee9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:18.126552 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f4eae8cd-6678-4d8f-82bf-23dbf7045ee9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:18.285443 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-f4eae8cd-6678-4d8f-82bf-23dbf7045ee9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:18.294965 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f4eae8cd-6678-4d8f-82bf-23dbf7045ee9 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1454 microversion: 2.1 time: 0.181831 Aug 04 10:34:18.296130 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 500/1046] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:18 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1454 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:18.892674 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2f33304c-491e-4f3c-9d47-e72834333dbf tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:18.893597 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2f33304c-491e-4f3c-9d47-e72834333dbf tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] [instance: 34e129c5-a1f4-418e-a7c7-8840c88c20e9] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:18.899641 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2f33304c-491e-4f3c-9d47-e72834333dbf tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:18.900122 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2f33304c-491e-4f3c-9d47-e72834333dbf tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:18.900875 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2f33304c-491e-4f3c-9d47-e72834333dbf tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:18.901308 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2f33304c-491e-4f3c-9d47-e72834333dbf tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:18.915168 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-2f33304c-491e-4f3c-9d47-e72834333dbf tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] HTTP exception thrown: Instance 34e129c5-a1f4-418e-a7c7-8840c88c20e9 could not be found. Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2f33304c-491e-4f3c-9d47-e72834333dbf tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Request method failure captured: Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 HTTP/1.1 Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi657gGeplUjFdCVN54_Fiz0_aJ7HqtNVY5HEtDRq7xaZrmxslc3Toq8P3MBIcEVPMMq_FIbxM7l6fDfrPiSDo3ERfY9BApDS5597IN0-tU0QFN8otpuPQzpbB6pInEGNLrvGkFAWW5ut_68L8wq_whcItj1b2H709dCnTeH5n-VAQlmw Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 5084c2b61ad2427d91e0fc85392aee14 Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-TestShelveInstance-867794144 Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:34:18.916755 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:34:18.918260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5084c2b61ad2427d91e0fc85392aee14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5084c2b61ad2427d91e0fc85392aee14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5084c2b61ad2427d91e0fc85392aee14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5084c2b61ad2427d91e0fc85392aee14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:34:18.918260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-TestShelveInstance-867794144 Aug 04 10:34:18.918260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 5084c2b61ad2427d91e0fc85392aee14 Aug 04 10:34:18.918260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-TestShelveInstance-867794144 Aug 04 10:34:18.918260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-TestShelveInstance-867794144-project Aug 04 10:34:18.918260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:34:18.918260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:34:18.918260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: c1ecb46bae9e4e369416d138203abe6f Aug 04 10:34:18.918260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-TestShelveInstance-867794144-project Aug 04 10:34:18.918260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:34:18.918260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance 34e129c5-a1f4-418e-a7c7-8840c88c20e9 could not be found. Aug 04 10:34:18.918260 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': '34e129c5-a1f4-418e-a7c7-8840c88c20e9'} Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34e129c5-a1f4-418e-a7c7-8840c88c20e9 could not be found. Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:34:18.919125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34e129c5-a1f4-418e-a7c7-8840c88c20e9 could not be found. Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34e129c5-a1f4-418e-a7c7-8840c88c20e9 could not be found. Aug 04 10:34:18.920604 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:34:18.921797 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2f33304c-491e-4f3c-9d47-e72834333dbf tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Returning 404 to user: Instance 34e129c5-a1f4-418e-a7c7-8840c88c20e9 could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:34:18.921797 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2f33304c-491e-4f3c-9d47-e72834333dbf tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9" status: 404 len: 111 microversion: 2.1 time: 0.029439 Aug 04 10:34:18.921797 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 547/1047] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:18 2022] GET /compute/v2.1/servers/34e129c5-a1f4-418e-a7c7-8840c88c20e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:34:19.093395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-0008b546-ec35-49f9-871d-1afc89a59434 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] Calling method '.version_select at 0x7fbaa4945af0>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:19.131901 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-0008b546-ec35-49f9-871d-1afc89a59434 tempest-TestShelveInstance-867794144 tempest-TestShelveInstance-867794144-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1352145375" status: 202 len: 0 microversion: 2.1 time: 0.043851 Aug 04 10:34:19.132511 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 501/1048] 10.222.0.72 () {58 vars in 1254 bytes} [Thu Aug 4 10:34:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1352145375 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:34:20.168406 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-c99c3537-d603-447b-b886-4e124673fa65 req-21d497a3-64d5-4865-8cd8-675aaf32891a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b53386c-d4ab-449c-a60a-bcb1aaff42ea", "tag": "f73efd39-7084-4080-b354-dd511042f3ee"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:20.179771 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-c99c3537-d603-447b-b886-4e124673fa65 req-21d497a3-64d5-4865-8cd8-675aaf32891a service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:20.180441 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-c99c3537-d603-447b-b886-4e124673fa65 req-21d497a3-64d5-4865-8cd8-675aaf32891a service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:20.195312 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-c99c3537-d603-447b-b886-4e124673fa65 req-21d497a3-64d5-4865-8cd8-675aaf32891a service nova] Creating event network-changed:f73efd39-7084-4080-b354-dd511042f3ee for instance 5b53386c-d4ab-449c-a60a-bcb1aaff42ea on hv-cinder-82660 Aug 04 10:34:20.200896 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-c99c3537-d603-447b-b886-4e124673fa65 req-21d497a3-64d5-4865-8cd8-675aaf32891a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036145 Aug 04 10:34:20.206650 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 548/1049] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:34:24.624018 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:24.629840 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-83700937-8914-400b-b3b4-9c4e3a9da5f7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:24.630852 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-83700937-8914-400b-b3b4-9c4e3a9da5f7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:24.639238 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-83700937-8914-400b-b3b4-9c4e3a9da5f7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:24.639688 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-83700937-8914-400b-b3b4-9c4e3a9da5f7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:24.640507 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-83700937-8914-400b-b3b4-9c4e3a9da5f7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:24.640978 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-83700937-8914-400b-b3b4-9c4e3a9da5f7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:24.851607 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-83700937-8914-400b-b3b4-9c4e3a9da5f7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:24.862576 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-83700937-8914-400b-b3b4-9c4e3a9da5f7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1594 microversion: 2.1 time: 0.239880 Aug 04 10:34:24.863147 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 502/1050] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:24 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1594 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:27.158063 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-73e0b4e4-cb89-4d4d-ae97-ec03b8239f74 req-bf449c1f-67e3-452e-a667-a99142d4a5fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b5f22b-45ce-40fe-8573-fcd858e5efed", "tag": "212d642e-6e42-4971-b584-f811951bcb45"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:27.176515 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-73e0b4e4-cb89-4d4d-ae97-ec03b8239f74 req-bf449c1f-67e3-452e-a667-a99142d4a5fd service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:27.178633 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-73e0b4e4-cb89-4d4d-ae97-ec03b8239f74 req-bf449c1f-67e3-452e-a667-a99142d4a5fd service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:27.198945 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-73e0b4e4-cb89-4d4d-ae97-ec03b8239f74 req-bf449c1f-67e3-452e-a667-a99142d4a5fd service nova] Creating event network-changed:212d642e-6e42-4971-b584-f811951bcb45 for instance d4b5f22b-45ce-40fe-8573-fcd858e5efed on hv-cinder-82660 Aug 04 10:34:27.210518 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-73e0b4e4-cb89-4d4d-ae97-ec03b8239f74 req-bf449c1f-67e3-452e-a667-a99142d4a5fd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057724 Aug 04 10:34:27.211487 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 549/1051] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:34:28.552338 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-dcc727b3-44ff-4232-bcf6-1936633ede83 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2030843865"}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:28.552891 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-dcc727b3-44ff-4232-bcf6-1936633ede83 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:28.559882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dcc727b3-44ff-4232-bcf6-1936633ede83 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:28.560383 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dcc727b3-44ff-4232-bcf6-1936633ede83 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:28.561153 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dcc727b3-44ff-4232-bcf6-1936633ede83 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:28.561590 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-dcc727b3-44ff-4232-bcf6-1936633ede83 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:28.689467 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.network.security_group_api [None req-dcc727b3-44ff-4232-bcf6-1936633ede83 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Adding security group 8a6b2cc5-75ee-4127-8dfb-45f270f5ec07 to port 212d642e-6e42-4971-b584-f811951bcb45 Aug 04 10:34:29.256405 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-dcc727b3-44ff-4232-bcf6-1936633ede83 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "POST /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/action" status: 202 len: 0 microversion: 2.1 time: 0.707967 Aug 04 10:34:29.260678 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 503/1052] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:34:28 2022] POST /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 10:34:29.267674 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-644a270a-c33b-4673-b9ce-45fb4b47f16f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:29.273027 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-c33f1445-74c6-415a-b121-52b75903521c req-452bca36-1c64-4e82-bf4c-d4419ef3f256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b5f22b-45ce-40fe-8573-fcd858e5efed", "tag": "212d642e-6e42-4971-b584-f811951bcb45"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:29.279158 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-644a270a-c33b-4673-b9ce-45fb4b47f16f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:29.286030 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-644a270a-c33b-4673-b9ce-45fb4b47f16f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:29.286572 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-644a270a-c33b-4673-b9ce-45fb4b47f16f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:29.287351 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-644a270a-c33b-4673-b9ce-45fb4b47f16f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:29.287926 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-644a270a-c33b-4673-b9ce-45fb4b47f16f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:29.299834 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-c33f1445-74c6-415a-b121-52b75903521c req-452bca36-1c64-4e82-bf4c-d4419ef3f256 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:29.300936 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-c33f1445-74c6-415a-b121-52b75903521c req-452bca36-1c64-4e82-bf4c-d4419ef3f256 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:29.333667 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-c33f1445-74c6-415a-b121-52b75903521c req-452bca36-1c64-4e82-bf4c-d4419ef3f256 service nova] Creating event network-changed:212d642e-6e42-4971-b584-f811951bcb45 for instance d4b5f22b-45ce-40fe-8573-fcd858e5efed on hv-cinder-82660 Aug 04 10:34:29.342194 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-c33f1445-74c6-415a-b121-52b75903521c req-452bca36-1c64-4e82-bf4c-d4419ef3f256 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072150 Aug 04 10:34:29.343093 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 504/1053] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:34:29.530171 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-644a270a-c33b-4673-b9ce-45fb4b47f16f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:29.538989 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-644a270a-c33b-4673-b9ce-45fb4b47f16f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1760 microversion: 2.1 time: 0.276865 Aug 04 10:34:29.539845 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 550/1054] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:34:29 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1760 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:01.867996 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:01.868841 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:01.873140 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-cfcd49a4-cdb2-494b-988a-e11a02a3ac71 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:01.875368 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-cfcd49a4-cdb2-494b-988a-e11a02a3ac71 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:01.885266 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cfcd49a4-cdb2-494b-988a-e11a02a3ac71 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:01.885711 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cfcd49a4-cdb2-494b-988a-e11a02a3ac71 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:01.886542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cfcd49a4-cdb2-494b-988a-e11a02a3ac71 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:01.886979 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-cfcd49a4-cdb2-494b-988a-e11a02a3ac71 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:01.961707 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-cfcd49a4-cdb2-494b-988a-e11a02a3ac71 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "POST /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/action" status: 202 len: 0 microversion: 2.1 time: 0.095035 Aug 04 10:35:01.962321 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 505/1055] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:35:01 2022] POST /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:35:01.971209 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-3c50638a-9c22-4241-93af-2942fb95bf59 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:01.971790 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-3c50638a-9c22-4241-93af-2942fb95bf59 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:01.974439 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:01.975598 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=28 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:01.982261 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3c50638a-9c22-4241-93af-2942fb95bf59 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:01.982728 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3c50638a-9c22-4241-93af-2942fb95bf59 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:01.983502 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3c50638a-9c22-4241-93af-2942fb95bf59 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:01.983979 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-3c50638a-9c22-4241-93af-2942fb95bf59 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:02.222688 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-3c50638a-9c22-4241-93af-2942fb95bf59 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:02.231836 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-3c50638a-9c22-4241-93af-2942fb95bf59 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1752 microversion: 2.1 time: 0.264927 Aug 04 10:35:02.232461 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 551/1056] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:01 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1752 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:03.254086 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5f42ba6e-ac65-49b1-be1c-3c94c611f92d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:03.254806 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5f42ba6e-ac65-49b1-be1c-3c94c611f92d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:03.262784 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5f42ba6e-ac65-49b1-be1c-3c94c611f92d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:03.263229 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5f42ba6e-ac65-49b1-be1c-3c94c611f92d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:03.264042 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5f42ba6e-ac65-49b1-be1c-3c94c611f92d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:03.264469 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5f42ba6e-ac65-49b1-be1c-3c94c611f92d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:03.564735 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5f42ba6e-ac65-49b1-be1c-3c94c611f92d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:03.572712 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5f42ba6e-ac65-49b1-be1c-3c94c611f92d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1757 microversion: 2.1 time: 0.322991 Aug 04 10:35:03.573253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 506/1057] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:03 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1757 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:04.593845 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b830da7d-298a-4faf-838c-a23520bac495 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:04.594485 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b830da7d-298a-4faf-838c-a23520bac495 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:04.601106 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b830da7d-298a-4faf-838c-a23520bac495 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:04.601550 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b830da7d-298a-4faf-838c-a23520bac495 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:04.602307 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b830da7d-298a-4faf-838c-a23520bac495 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:04.602738 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b830da7d-298a-4faf-838c-a23520bac495 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:04.806576 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b830da7d-298a-4faf-838c-a23520bac495 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:04.814673 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b830da7d-298a-4faf-838c-a23520bac495 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1757 microversion: 2.1 time: 0.224795 Aug 04 10:35:04.815225 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 552/1058] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:04 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:05.837030 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-32c060c0-525d-49cd-9a6c-7d2e4fd270e7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:05.837668 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-32c060c0-525d-49cd-9a6c-7d2e4fd270e7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:05.844882 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-32c060c0-525d-49cd-9a6c-7d2e4fd270e7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:05.845332 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-32c060c0-525d-49cd-9a6c-7d2e4fd270e7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:05.846100 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-32c060c0-525d-49cd-9a6c-7d2e4fd270e7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:05.846531 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-32c060c0-525d-49cd-9a6c-7d2e4fd270e7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:05.990579 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-32c060c0-525d-49cd-9a6c-7d2e4fd270e7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:05.998577 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-32c060c0-525d-49cd-9a6c-7d2e4fd270e7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1757 microversion: 2.1 time: 0.165569 Aug 04 10:35:05.999141 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 507/1059] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:05 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:07.022128 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5142f8a4-0ddf-4bec-9920-0497e7f23b1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:07.022897 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5142f8a4-0ddf-4bec-9920-0497e7f23b1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:07.030036 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5142f8a4-0ddf-4bec-9920-0497e7f23b1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:07.030490 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5142f8a4-0ddf-4bec-9920-0497e7f23b1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:07.031283 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5142f8a4-0ddf-4bec-9920-0497e7f23b1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:07.031761 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5142f8a4-0ddf-4bec-9920-0497e7f23b1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:07.189668 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-5142f8a4-0ddf-4bec-9920-0497e7f23b1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:07.197749 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5142f8a4-0ddf-4bec-9920-0497e7f23b1e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1757 microversion: 2.1 time: 0.179633 Aug 04 10:35:07.198261 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 553/1060] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:07 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:08.218678 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-4f70fe79-cdbf-4505-82b1-704e5b3aa9cb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:08.219211 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-4f70fe79-cdbf-4505-82b1-704e5b3aa9cb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:08.226253 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4f70fe79-cdbf-4505-82b1-704e5b3aa9cb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:08.226695 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4f70fe79-cdbf-4505-82b1-704e5b3aa9cb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:08.227454 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4f70fe79-cdbf-4505-82b1-704e5b3aa9cb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:08.227884 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-4f70fe79-cdbf-4505-82b1-704e5b3aa9cb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:08.368189 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-4f70fe79-cdbf-4505-82b1-704e5b3aa9cb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:08.376363 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-4f70fe79-cdbf-4505-82b1-704e5b3aa9cb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1757 microversion: 2.1 time: 0.161558 Aug 04 10:35:08.376935 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 508/1061] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:08 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:09.398246 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-59149890-584d-4971-9a97-39d11229de37 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:09.398874 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-59149890-584d-4971-9a97-39d11229de37 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:09.405248 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-59149890-584d-4971-9a97-39d11229de37 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:09.405864 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-59149890-584d-4971-9a97-39d11229de37 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:09.406428 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-59149890-584d-4971-9a97-39d11229de37 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:09.406872 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-59149890-584d-4971-9a97-39d11229de37 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:09.547182 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-59149890-584d-4971-9a97-39d11229de37 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:09.555203 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-59149890-584d-4971-9a97-39d11229de37 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1757 microversion: 2.1 time: 0.161791 Aug 04 10:35:09.556029 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 554/1062] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:09 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:10.577048 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-534de906-6c1f-4b2d-bb90-7c76f45612ec tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:10.577746 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-534de906-6c1f-4b2d-bb90-7c76f45612ec tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:10.584576 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-534de906-6c1f-4b2d-bb90-7c76f45612ec tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:10.585029 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-534de906-6c1f-4b2d-bb90-7c76f45612ec tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:10.585791 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-534de906-6c1f-4b2d-bb90-7c76f45612ec tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:10.586229 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-534de906-6c1f-4b2d-bb90-7c76f45612ec tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:10.737452 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-534de906-6c1f-4b2d-bb90-7c76f45612ec tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:10.746163 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-534de906-6c1f-4b2d-bb90-7c76f45612ec tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1757 microversion: 2.1 time: 0.173008 Aug 04 10:35:10.746731 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 509/1063] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:10 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:11.767017 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ebf8df91-48a7-479b-ab46-92889179e52e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:11.767647 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ebf8df91-48a7-479b-ab46-92889179e52e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:11.774917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ebf8df91-48a7-479b-ab46-92889179e52e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:11.775389 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ebf8df91-48a7-479b-ab46-92889179e52e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:11.776219 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ebf8df91-48a7-479b-ab46-92889179e52e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:11.776709 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-ebf8df91-48a7-479b-ab46-92889179e52e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:11.921193 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ebf8df91-48a7-479b-ab46-92889179e52e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:11.929999 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ebf8df91-48a7-479b-ab46-92889179e52e tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1757 microversion: 2.1 time: 0.166762 Aug 04 10:35:11.930819 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 555/1064] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:11 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:12.950400 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ea2ee9b9-fd57-4c18-a6e0-361bcf28bbcb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:12.951380 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ea2ee9b9-fd57-4c18-a6e0-361bcf28bbcb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:12.958645 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ea2ee9b9-fd57-4c18-a6e0-361bcf28bbcb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:12.959086 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ea2ee9b9-fd57-4c18-a6e0-361bcf28bbcb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:12.959851 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ea2ee9b9-fd57-4c18-a6e0-361bcf28bbcb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:12.960302 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ea2ee9b9-fd57-4c18-a6e0-361bcf28bbcb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:13.115331 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-ea2ee9b9-fd57-4c18-a6e0-361bcf28bbcb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:13.124655 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ea2ee9b9-fd57-4c18-a6e0-361bcf28bbcb tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1757 microversion: 2.1 time: 0.178006 Aug 04 10:35:13.125632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 510/1065] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:12 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:14.146650 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-c8269d2a-2905-4916-acba-d984beba9fb7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:14.147258 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-c8269d2a-2905-4916-acba-d984beba9fb7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:14.154401 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c8269d2a-2905-4916-acba-d984beba9fb7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:14.154851 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c8269d2a-2905-4916-acba-d984beba9fb7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:14.155615 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c8269d2a-2905-4916-acba-d984beba9fb7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:14.156080 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-c8269d2a-2905-4916-acba-d984beba9fb7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:14.302534 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-c8269d2a-2905-4916-acba-d984beba9fb7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:14.311896 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-c8269d2a-2905-4916-acba-d984beba9fb7 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1760 microversion: 2.1 time: 0.169089 Aug 04 10:35:14.312566 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 556/1066] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:14 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:20.444410 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-84394689", "imageRef": "de8bb19c-0138-4203-8d77-01ff0247022b", "flavorRef": "452"}} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:20.496037 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.network.neutron [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] validate_networks() for None {{(pid=117667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:35:20.761402 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Flavor limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:35:20.761945 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Image limits 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:35:20.762449 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Flavor pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:35:20.762888 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Image pref 0:0:0 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:35:20.763300 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.virt.hardware [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:35:20.773205 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:20.773649 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:20.774443 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:20.774874 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:20.791290 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Getting quotas for project cb4dcadb63b142a89d9aa9d3ce4044d0. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:35:20.795161 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.quota [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Getting quotas for user ec582d8fc1f146faa6af71564edc1f4b and project cb4dcadb63b142a89d9aa9d3ce4044d0. Resources: {'ram', 'cores', 'instances'} {{(pid=117667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:35:20.806843 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Going to run 1 instances... {{(pid=117667) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:35:20.809118 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de8bb19c-0138-4203-8d77-01ff0247022b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:35:20.853527 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-f00ef696-a026-41d7-af89-a6803db730c0 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.412813 Aug 04 10:35:20.854165 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 511/1067] 10.222.0.72 () {60 vars in 1147 bytes} [Thu Aug 4 10:35:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 10:35:20.865446 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-ad35e511-0782-4456-bbcb-849e31c2da45 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:20.866630 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-ad35e511-0782-4456-bbcb-849e31c2da45 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:20.921255 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-ad35e511-0782-4456-bbcb-849e31c2da45 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec582d8fc1f146faa6af71564edc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4dcadb63b142a89d9aa9d3ce4044d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:20.928597 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-ad35e511-0782-4456-bbcb-849e31c2da45 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 200 len: 1213 microversion: 2.1 time: 0.067545 Aug 04 10:35:20.929170 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 557/1068] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:20 2022] GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:21.949602 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-ae3d9e85-c3a7-4e11-9efb-a4de5ce57e3f tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:21.950213 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-ae3d9e85-c3a7-4e11-9efb-a4de5ce57e3f tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:21.957886 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ae3d9e85-c3a7-4e11-9efb-a4de5ce57e3f tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:21.958832 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ae3d9e85-c3a7-4e11-9efb-a4de5ce57e3f tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:21.959813 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ae3d9e85-c3a7-4e11-9efb-a4de5ce57e3f tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:21.960280 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-ae3d9e85-c3a7-4e11-9efb-a4de5ce57e3f tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:22.044225 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-ae3d9e85-c3a7-4e11-9efb-a4de5ce57e3f tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec582d8fc1f146faa6af71564edc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4dcadb63b142a89d9aa9d3ce4044d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:22.054891 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-ae3d9e85-c3a7-4e11-9efb-a4de5ce57e3f tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 200 len: 1283 microversion: 2.1 time: 0.109532 Aug 04 10:35:22.056316 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 512/1069] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:21 2022] GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 1283 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:23.076821 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-11263e3f-af4d-49a7-a6fb-cc765da90881 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:23.077429 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-11263e3f-af4d-49a7-a6fb-cc765da90881 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:23.085426 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11263e3f-af4d-49a7-a6fb-cc765da90881 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:23.085870 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11263e3f-af4d-49a7-a6fb-cc765da90881 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:23.086631 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11263e3f-af4d-49a7-a6fb-cc765da90881 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:23.087063 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-11263e3f-af4d-49a7-a6fb-cc765da90881 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:23.313584 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-11263e3f-af4d-49a7-a6fb-cc765da90881 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec582d8fc1f146faa6af71564edc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4dcadb63b142a89d9aa9d3ce4044d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:23.321631 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-11263e3f-af4d-49a7-a6fb-cc765da90881 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 200 len: 1313 microversion: 2.1 time: 0.248670 Aug 04 10:35:23.322288 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 558/1070] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:23 2022] GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:23.421143 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-23d6f87b-4af8-4236-a339-982f07939321 req-e8e797d7-2588-4535-8fe9-87c5bdcc80e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec079b3-4370-457d-a76c-960e1c1a59b1", "tag": "e51e34ae-c138-4226-8b39-972c538bc672"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:23.434812 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-23d6f87b-4af8-4236-a339-982f07939321 req-e8e797d7-2588-4535-8fe9-87c5bdcc80e8 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:23.435256 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-23d6f87b-4af8-4236-a339-982f07939321 req-e8e797d7-2588-4535-8fe9-87c5bdcc80e8 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:23.447441 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-23d6f87b-4af8-4236-a339-982f07939321 req-e8e797d7-2588-4535-8fe9-87c5bdcc80e8 service nova] Creating event network-changed:e51e34ae-c138-4226-8b39-972c538bc672 for instance 7ec079b3-4370-457d-a76c-960e1c1a59b1 on hv-cinder-82660 Aug 04 10:35:23.452607 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-23d6f87b-4af8-4236-a339-982f07939321 req-e8e797d7-2588-4535-8fe9-87c5bdcc80e8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035480 Aug 04 10:35:23.453367 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 513/1071] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:35:24.342434 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-927c0bd2-b268-4f4a-9258-fe7bc3008db2 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:24.343048 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-927c0bd2-b268-4f4a-9258-fe7bc3008db2 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:24.349821 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-927c0bd2-b268-4f4a-9258-fe7bc3008db2 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:24.350274 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-927c0bd2-b268-4f4a-9258-fe7bc3008db2 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:24.351038 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-927c0bd2-b268-4f4a-9258-fe7bc3008db2 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:24.351476 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-927c0bd2-b268-4f4a-9258-fe7bc3008db2 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:24.476751 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-927c0bd2-b268-4f4a-9258-fe7bc3008db2 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec582d8fc1f146faa6af71564edc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4dcadb63b142a89d9aa9d3ce4044d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:24.484133 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-927c0bd2-b268-4f4a-9258-fe7bc3008db2 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 200 len: 1313 microversion: 2.1 time: 0.145522 Aug 04 10:35:24.484692 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 559/1072] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:24 2022] GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:25.504940 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-b8b86a34-c8eb-485e-895d-55eef9855e19 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:25.505622 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-b8b86a34-c8eb-485e-895d-55eef9855e19 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:25.512715 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b8b86a34-c8eb-485e-895d-55eef9855e19 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:25.513155 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b8b86a34-c8eb-485e-895d-55eef9855e19 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:25.513916 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b8b86a34-c8eb-485e-895d-55eef9855e19 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:25.514345 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-b8b86a34-c8eb-485e-895d-55eef9855e19 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:25.650775 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-b8b86a34-c8eb-485e-895d-55eef9855e19 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec582d8fc1f146faa6af71564edc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4dcadb63b142a89d9aa9d3ce4044d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:25.658207 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-b8b86a34-c8eb-485e-895d-55eef9855e19 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 200 len: 1313 microversion: 2.1 time: 0.157714 Aug 04 10:35:25.658759 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 514/1073] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:25 2022] GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:26.678876 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-272d2371-aa8f-4b0a-ab8c-96ed14679863 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:26.679609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-272d2371-aa8f-4b0a-ab8c-96ed14679863 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:26.686358 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-272d2371-aa8f-4b0a-ab8c-96ed14679863 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:26.686800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-272d2371-aa8f-4b0a-ab8c-96ed14679863 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:26.687556 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-272d2371-aa8f-4b0a-ab8c-96ed14679863 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:26.688003 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-272d2371-aa8f-4b0a-ab8c-96ed14679863 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:26.819002 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-272d2371-aa8f-4b0a-ab8c-96ed14679863 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec582d8fc1f146faa6af71564edc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4dcadb63b142a89d9aa9d3ce4044d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:26.826527 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-272d2371-aa8f-4b0a-ab8c-96ed14679863 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 200 len: 1313 microversion: 2.1 time: 0.151461 Aug 04 10:35:26.827079 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 560/1074] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:26 2022] GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:27.847169 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-5a1559be-d584-42ce-8469-19f5648c552b tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:27.847779 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-5a1559be-d584-42ce-8469-19f5648c552b tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:27.854907 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a1559be-d584-42ce-8469-19f5648c552b tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:27.855355 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a1559be-d584-42ce-8469-19f5648c552b tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:27.856145 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a1559be-d584-42ce-8469-19f5648c552b tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:27.856581 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-5a1559be-d584-42ce-8469-19f5648c552b tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:27.986593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-5a1559be-d584-42ce-8469-19f5648c552b tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec582d8fc1f146faa6af71564edc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4dcadb63b142a89d9aa9d3ce4044d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:27.994029 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-5a1559be-d584-42ce-8469-19f5648c552b tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 200 len: 1313 microversion: 2.1 time: 0.150753 Aug 04 10:35:27.994593 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 515/1075] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:27 2022] GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:28.314944 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-5b4b60be-0dcb-498d-a5fe-3bdae3e5dd68 req-7f823ab1-f7f1-4565-a188-86774aacdc0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec079b3-4370-457d-a76c-960e1c1a59b1", "name": "network-vif-plugged", "status": "completed", "tag": "e51e34ae-c138-4226-8b39-972c538bc672"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:28.326034 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-5b4b60be-0dcb-498d-a5fe-3bdae3e5dd68 req-7f823ab1-f7f1-4565-a188-86774aacdc0d service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:28.326470 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-5b4b60be-0dcb-498d-a5fe-3bdae3e5dd68 req-7f823ab1-f7f1-4565-a188-86774aacdc0d service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:28.337583 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-5b4b60be-0dcb-498d-a5fe-3bdae3e5dd68 req-7f823ab1-f7f1-4565-a188-86774aacdc0d service nova] Creating event network-vif-plugged:e51e34ae-c138-4226-8b39-972c538bc672 for instance 7ec079b3-4370-457d-a76c-960e1c1a59b1 on hv-cinder-82660 Aug 04 10:35:28.342455 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-5b4b60be-0dcb-498d-a5fe-3bdae3e5dd68 req-7f823ab1-f7f1-4565-a188-86774aacdc0d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031188 Aug 04 10:35:28.343038 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 561/1076] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:35:29.015713 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-534b0a43-bdfc-4166-8fbf-591dec57b5e3 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:29.016350 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-534b0a43-bdfc-4166-8fbf-591dec57b5e3 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:29.023747 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-534b0a43-bdfc-4166-8fbf-591dec57b5e3 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:29.024201 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-534b0a43-bdfc-4166-8fbf-591dec57b5e3 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:29.024972 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-534b0a43-bdfc-4166-8fbf-591dec57b5e3 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:29.025407 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-534b0a43-bdfc-4166-8fbf-591dec57b5e3 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:29.154314 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-534b0a43-bdfc-4166-8fbf-591dec57b5e3 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec582d8fc1f146faa6af71564edc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4dcadb63b142a89d9aa9d3ce4044d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:29.161881 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-534b0a43-bdfc-4166-8fbf-591dec57b5e3 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 200 len: 1313 microversion: 2.1 time: 0.150025 Aug 04 10:35:29.162447 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 516/1077] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:29 2022] GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:30.183328 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4143d09d-e007-4b55-bf67-296182482af8 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:30.184041 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4143d09d-e007-4b55-bf67-296182482af8 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:30.190180 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4143d09d-e007-4b55-bf67-296182482af8 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:30.190626 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4143d09d-e007-4b55-bf67-296182482af8 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:30.191376 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4143d09d-e007-4b55-bf67-296182482af8 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:30.191806 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4143d09d-e007-4b55-bf67-296182482af8 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:30.335563 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4143d09d-e007-4b55-bf67-296182482af8 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec582d8fc1f146faa6af71564edc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4dcadb63b142a89d9aa9d3ce4044d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:30.343742 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4143d09d-e007-4b55-bf67-296182482af8 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 200 len: 1313 microversion: 2.1 time: 0.165309 Aug 04 10:35:30.344333 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 562/1078] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:30 2022] GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:31.364670 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-27712b93-f28d-4c30-915b-3463b8bc8746 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:31.365269 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-27712b93-f28d-4c30-915b-3463b8bc8746 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:31.367356 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=2 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:31.368078 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell0:SELECT=6 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:31.374085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-27712b93-f28d-4c30-915b-3463b8bc8746 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:31.374523 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-27712b93-f28d-4c30-915b-3463b8bc8746 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:31.375273 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-27712b93-f28d-4c30-915b-3463b8bc8746 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:31.375698 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-27712b93-f28d-4c30-915b-3463b8bc8746 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:31.506276 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-27712b93-f28d-4c30-915b-3463b8bc8746 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec582d8fc1f146faa6af71564edc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4dcadb63b142a89d9aa9d3ce4044d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:31.513723 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-27712b93-f28d-4c30-915b-3463b8bc8746 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 200 len: 1462 microversion: 2.1 time: 0.153158 Aug 04 10:35:31.514290 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 517/1079] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:31 2022] GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 1462 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:31.557889 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-737b17a9-f4df-4535-8841-3eaa13f73832 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:31.558559 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-737b17a9-f4df-4535-8841-3eaa13f73832 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:31.560593 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell0:SELECT=2 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:31.566303 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-737b17a9-f4df-4535-8841-3eaa13f73832 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:31.566750 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-737b17a9-f4df-4535-8841-3eaa13f73832 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:31.567509 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-737b17a9-f4df-4535-8841-3eaa13f73832 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:31.567939 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-737b17a9-f4df-4535-8841-3eaa13f73832 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:31.594605 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-737b17a9-f4df-4535-8841-3eaa13f73832 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:35:31.678246 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-737b17a9-f4df-4535-8841-3eaa13f73832 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 204 len: 0 microversion: 2.1 time: 0.124115 Aug 04 10:35:31.678836 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 563/1080] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:35:31 2022] DELETE /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:35:31.687131 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-642a8293-7f39-465d-8d7c-051a49eb64d1 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:31.687730 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-642a8293-7f39-465d-8d7c-051a49eb64d1 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:31.694156 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-642a8293-7f39-465d-8d7c-051a49eb64d1 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:31.694622 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-642a8293-7f39-465d-8d7c-051a49eb64d1 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:31.695371 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-642a8293-7f39-465d-8d7c-051a49eb64d1 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:31.695795 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-642a8293-7f39-465d-8d7c-051a49eb64d1 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:31.825548 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-642a8293-7f39-465d-8d7c-051a49eb64d1 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec582d8fc1f146faa6af71564edc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4dcadb63b142a89d9aa9d3ce4044d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:31.833632 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-642a8293-7f39-465d-8d7c-051a49eb64d1 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 200 len: 1468 microversion: 2.1 time: 0.149547 Aug 04 10:35:31.834197 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 518/1081] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:31 2022] GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 1468 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:32.855514 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-9e04b4ef-2db8-4f1a-9f81-1fdde6d17f22 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:32.856232 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-9e04b4ef-2db8-4f1a-9f81-1fdde6d17f22 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:32.858565 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:32.864087 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e04b4ef-2db8-4f1a-9f81-1fdde6d17f22 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:32.864538 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e04b4ef-2db8-4f1a-9f81-1fdde6d17f22 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:32.865292 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e04b4ef-2db8-4f1a-9f81-1fdde6d17f22 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:32.865726 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-9e04b4ef-2db8-4f1a-9f81-1fdde6d17f22 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:32.869154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:32.995935 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-9e04b4ef-2db8-4f1a-9f81-1fdde6d17f22 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec582d8fc1f146faa6af71564edc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4dcadb63b142a89d9aa9d3ce4044d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:33.003405 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-9e04b4ef-2db8-4f1a-9f81-1fdde6d17f22 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 200 len: 1468 microversion: 2.1 time: 0.152237 Aug 04 10:35:33.003999 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 564/1082] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:32 2022] GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 1468 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:33.763830 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-e868fd75-6c9e-4506-805b-442996b0cc09 req-eecfe1a1-97d8-4c69-92b8-e068ddfd6869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec079b3-4370-457d-a76c-960e1c1a59b1", "name": "network-vif-deleted", "tag": "e51e34ae-c138-4226-8b39-972c538bc672"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:33.773287 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:33.775421 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-e868fd75-6c9e-4506-805b-442996b0cc09 req-eecfe1a1-97d8-4c69-92b8-e068ddfd6869 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:33.776091 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-e868fd75-6c9e-4506-805b-442996b0cc09 req-eecfe1a1-97d8-4c69-92b8-e068ddfd6869 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:33.780451 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:33.789817 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-e868fd75-6c9e-4506-805b-442996b0cc09 req-eecfe1a1-97d8-4c69-92b8-e068ddfd6869 service nova] Creating event network-vif-deleted:e51e34ae-c138-4226-8b39-972c538bc672 for instance 7ec079b3-4370-457d-a76c-960e1c1a59b1 on hv-cinder-82660 Aug 04 10:35:33.795085 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-e868fd75-6c9e-4506-805b-442996b0cc09 req-eecfe1a1-97d8-4c69-92b8-e068ddfd6869 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034843 Aug 04 10:35:33.795684 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 519/1083] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:35:34.030727 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b23b4474-fa07-480f-93c5-74c747358889 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:34.031275 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b23b4474-fa07-480f-93c5-74c747358889 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:34.038198 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b23b4474-fa07-480f-93c5-74c747358889 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:34.038641 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b23b4474-fa07-480f-93c5-74c747358889 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:34.039388 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b23b4474-fa07-480f-93c5-74c747358889 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:34.039813 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b23b4474-fa07-480f-93c5-74c747358889 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:34.070197 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b23b4474-fa07-480f-93c5-74c747358889 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:34.070634 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b23b4474-fa07-480f-93c5-74c747358889 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:34.071072 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-b23b4474-fa07-480f-93c5-74c747358889 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lazy-loading 'fault' on Instance uuid 7ec079b3-4370-457d-a76c-960e1c1a59b1 {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:35:34.110997 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b23b4474-fa07-480f-93c5-74c747358889 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec582d8fc1f146faa6af71564edc1f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4dcadb63b142a89d9aa9d3ce4044d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:34.119328 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b23b4474-fa07-480f-93c5-74c747358889 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 200 len: 1303 microversion: 2.1 time: 0.092616 Aug 04 10:35:34.119877 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 565/1084] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:34 2022] GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:35.141259 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-426a5105-efba-4fd4-8800-4fbbff041650 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:35.141945 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-426a5105-efba-4fd4-8800-4fbbff041650 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] [instance: 7ec079b3-4370-457d-a76c-960e1c1a59b1] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:35.149459 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-426a5105-efba-4fd4-8800-4fbbff041650 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:35.149907 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-426a5105-efba-4fd4-8800-4fbbff041650 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:35.150667 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-426a5105-efba-4fd4-8800-4fbbff041650 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:35.151099 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-426a5105-efba-4fd4-8800-4fbbff041650 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:35.165208 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-426a5105-efba-4fd4-8800-4fbbff041650 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] HTTP exception thrown: Instance 7ec079b3-4370-457d-a76c-960e1c1a59b1 could not be found. Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-426a5105-efba-4fd4-8800-4fbbff041650 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Request method failure captured: Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 HTTP/1.1 Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi66Dm7P8fvoUO2EgYfFWlmuSWXMxAjvwPQNNvasLyeY4SEw1kbZjl5IvtoM0FCvgkQJ2icI30sJX_imj4TUX-SclMTZYDteSSr2ZRF9dB8WVRf_p2Q1jdpXUPZVfyF7US-bDSNedrybkuOOWe792BLZ10RHTUtL3W4WpZ-nzQJsXxfPo Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: cb4dcadb63b142a89d9aa9d3ce4044d0 Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-VolumesNegativeTest-1688609492 Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:35:35.166819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:35:35.168542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cb4dcadb63b142a89d9aa9d3ce4044d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cb4dcadb63b142a89d9aa9d3ce4044d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cb4dcadb63b142a89d9aa9d3ce4044d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cb4dcadb63b142a89d9aa9d3ce4044d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:35:35.168542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-VolumesNegativeTest-1688609492 Aug 04 10:35:35.168542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: cb4dcadb63b142a89d9aa9d3ce4044d0 Aug 04 10:35:35.168542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-VolumesNegativeTest-1688609492 Aug 04 10:35:35.168542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-VolumesNegativeTest-1688609492-project Aug 04 10:35:35.168542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:35:35.168542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:35:35.168542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: ec582d8fc1f146faa6af71564edc1f4b Aug 04 10:35:35.168542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-VolumesNegativeTest-1688609492-project Aug 04 10:35:35.168542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:35:35.168542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 7ec079b3-4370-457d-a76c-960e1c1a59b1 could not be found. Aug 04 10:35:35.168542 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '7ec079b3-4370-457d-a76c-960e1c1a59b1'} Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ec079b3-4370-457d-a76c-960e1c1a59b1 could not be found. Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:35:35.169538 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec079b3-4370-457d-a76c-960e1c1a59b1 could not be found. Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec079b3-4370-457d-a76c-960e1c1a59b1 could not be found. Aug 04 10:35:35.171089 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:35:35.173113 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-426a5105-efba-4fd4-8800-4fbbff041650 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] Returning 404 to user: Instance 7ec079b3-4370-457d-a76c-960e1c1a59b1 could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:35:35.173113 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-426a5105-efba-4fd4-8800-4fbbff041650 tempest-VolumesNegativeTest-1688609492 tempest-VolumesNegativeTest-1688609492-project] 10.222.0.72 "GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1" status: 404 len: 111 microversion: 2.1 time: 0.031617 Aug 04 10:35:35.173113 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 520/1085] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:35 2022] GET /compute/v2.1/servers/7ec079b3-4370-457d-a76c-960e1c1a59b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:35:55.709179 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-6c026a6f-60a6-4cfd-8041-211ee2608de4 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2030843865"}} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:55.709761 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-6c026a6f-60a6-4cfd-8041-211ee2608de4 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:55.712383 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=5 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:55.713039 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=13 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:55.718782 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6c026a6f-60a6-4cfd-8041-211ee2608de4 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:55.719232 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6c026a6f-60a6-4cfd-8041-211ee2608de4 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:55.720020 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6c026a6f-60a6-4cfd-8041-211ee2608de4 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:55.720460 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-6c026a6f-60a6-4cfd-8041-211ee2608de4 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:55.844910 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.network.security_group_api [None req-6c026a6f-60a6-4cfd-8041-211ee2608de4 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Removing security group 8a6b2cc5-75ee-4127-8dfb-45f270f5ec07 from port 212d642e-6e42-4971-b584-f811951bcb45 Aug 04 10:35:56.152495 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-6c026a6f-60a6-4cfd-8041-211ee2608de4 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "POST /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/action" status: 202 len: 0 microversion: 2.1 time: 0.447091 Aug 04 10:35:56.157142 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 566/1086] 10.222.0.72 () {60 vars in 1278 bytes} [Thu Aug 4 10:35:55 2022] POST /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:35:56.164782 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-fa2ba4ab-d6e2-49a7-86b8-90c19bf0004c req-51c94157-cfdf-4f92-9206-c28cbd984d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b5f22b-45ce-40fe-8573-fcd858e5efed", "tag": "212d642e-6e42-4971-b584-f811951bcb45"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:56.170309 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_api:SELECT=3 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:56.171155 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=3 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:56.176986 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-fa2ba4ab-d6e2-49a7-86b8-90c19bf0004c req-51c94157-cfdf-4f92-9206-c28cbd984d11 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:56.177460 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-fa2ba4ab-d6e2-49a7-86b8-90c19bf0004c req-51c94157-cfdf-4f92-9206-c28cbd984d11 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:56.189324 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-fa2ba4ab-d6e2-49a7-86b8-90c19bf0004c req-51c94157-cfdf-4f92-9206-c28cbd984d11 service nova] Creating event network-changed:212d642e-6e42-4971-b584-f811951bcb45 for instance d4b5f22b-45ce-40fe-8573-fcd858e5efed on hv-cinder-82660 Aug 04 10:35:56.194503 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-fa2ba4ab-d6e2-49a7-86b8-90c19bf0004c req-51c94157-cfdf-4f92-9206-c28cbd984d11 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033956 Aug 04 10:35:56.195314 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 521/1087] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:35:57.214270 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0fa7311b-4b31-4c18-bc4d-c20d143f3b44 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:57.214800 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0fa7311b-4b31-4c18-bc4d-c20d143f3b44 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:57.222071 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0fa7311b-4b31-4c18-bc4d-c20d143f3b44 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:57.222709 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0fa7311b-4b31-4c18-bc4d-c20d143f3b44 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:57.223480 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0fa7311b-4b31-4c18-bc4d-c20d143f3b44 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:57.223915 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0fa7311b-4b31-4c18-bc4d-c20d143f3b44 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:57.325238 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-0fa7311b-4b31-4c18-bc4d-c20d143f3b44 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lazy-loading 'services' on Instance uuid d4b5f22b-45ce-40fe-8573-fcd858e5efed {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:35:57.370892 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-bebb7cfa-2e32-4cd7-b3f7-66a23153932c req-5d262b37-f518-4a6c-bc29-e788eddef0ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b5f22b-45ce-40fe-8573-fcd858e5efed", "tag": "212d642e-6e42-4971-b584-f811951bcb45"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:57.381455 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-bebb7cfa-2e32-4cd7-b3f7-66a23153932c req-5d262b37-f518-4a6c-bc29-e788eddef0ac service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:57.381897 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-bebb7cfa-2e32-4cd7-b3f7-66a23153932c req-5d262b37-f518-4a6c-bc29-e788eddef0ac service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:57.393305 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-bebb7cfa-2e32-4cd7-b3f7-66a23153932c req-5d262b37-f518-4a6c-bc29-e788eddef0ac service nova] Creating event network-changed:212d642e-6e42-4971-b584-f811951bcb45 for instance d4b5f22b-45ce-40fe-8573-fcd858e5efed on hv-cinder-82660 Aug 04 10:35:57.399104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-bebb7cfa-2e32-4cd7-b3f7-66a23153932c req-5d262b37-f518-4a6c-bc29-e788eddef0ac service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186853 Aug 04 10:35:57.400092 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 522/1088] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:35:57.406983 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0fa7311b-4b31-4c18-bc4d-c20d143f3b44 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/os-volume_attachments/7c66668f-9a07-4929-8949-53ad26b75f50" status: 202 len: 0 microversion: 2.1 time: 0.197851 Aug 04 10:35:57.407581 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 567/1089] 10.222.0.72 () {58 vars in 1416 bytes} [Thu Aug 4 10:35:57 2022] DELETE /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/os-volume_attachments/7c66668f-9a07-4929-8949-53ad26b75f50 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:35:57.417342 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-89a2ab94-b6d5-4b3e-a1f9-171e1770289d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:57.419867 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-89a2ab94-b6d5-4b3e-a1f9-171e1770289d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:57.427147 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-89a2ab94-b6d5-4b3e-a1f9-171e1770289d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:57.428438 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-89a2ab94-b6d5-4b3e-a1f9-171e1770289d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:57.429519 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-89a2ab94-b6d5-4b3e-a1f9-171e1770289d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:57.429972 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-89a2ab94-b6d5-4b3e-a1f9-171e1770289d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:57.468153 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-89a2ab94-b6d5-4b3e-a1f9-171e1770289d tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053871 Aug 04 10:35:57.472158 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 523/1090] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:35:57 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:35:58.482037 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-de66d802-e3e5-422a-986c-1de7bc7f27d9 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:58.484294 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-de66d802-e3e5-422a-986c-1de7bc7f27d9 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:58.490606 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de66d802-e3e5-422a-986c-1de7bc7f27d9 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:58.491051 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de66d802-e3e5-422a-986c-1de7bc7f27d9 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:58.491808 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de66d802-e3e5-422a-986c-1de7bc7f27d9 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:58.492263 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-de66d802-e3e5-422a-986c-1de7bc7f27d9 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:58.522085 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-de66d802-e3e5-422a-986c-1de7bc7f27d9 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044913 Aug 04 10:35:58.522627 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 568/1091] 10.222.0.72 () {58 vars in 1302 bytes} [Thu Aug 4 10:35:58 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:35:58.533604 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-fefcb4f0-c3bb-448c-b59b-f250753aa34f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:58.534110 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-fefcb4f0-c3bb-448c-b59b-f250753aa34f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:58.541397 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fefcb4f0-c3bb-448c-b59b-f250753aa34f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:58.541943 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fefcb4f0-c3bb-448c-b59b-f250753aa34f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:58.542697 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fefcb4f0-c3bb-448c-b59b-f250753aa34f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:58.543128 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-fefcb4f0-c3bb-448c-b59b-f250753aa34f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:58.616343 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-fefcb4f0-c3bb-448c-b59b-f250753aa34f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] HTTP exception thrown: Instance d4b5f22b-45ce-40fe-8573-fcd858e5efed is not attached to volume 7c66668f-9a07-4929-8949-53ad26b75f50 Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-fefcb4f0-c3bb-448c-b59b-f250753aa34f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Request method failure captured: Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: DELETE /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/os-volume_attachments/7c66668f-9a07-4929-8949-53ad26b75f50 HTTP/1.1 Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi66B40vM1MMxTrdYgF7xlZEoUHhS481utTazy25e33tJX72E4HOWky6MBWdjJyOJJJS0hSUXcbgQDyQVFZyn-Vn0FKgvrih4Y61V5A9tKcfSvNfRfjCHpYlEH6t0E_PPNqBzewlnyRYFyLfjPlUU3xuetqH7Qx8wyLEmlU67hn-PMnhU Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: f63d8ac72593445089042fd7c3a31651 Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-TestMinimumBasicScenario-1281963046 Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:35:58.618737 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:35:58.620521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f63d8ac72593445089042fd7c3a31651"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f63d8ac72593445089042fd7c3a31651"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f63d8ac72593445089042fd7c3a31651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f63d8ac72593445089042fd7c3a31651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:35:58.620521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-TestMinimumBasicScenario-1281963046 Aug 04 10:35:58.620521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: f63d8ac72593445089042fd7c3a31651 Aug 04 10:35:58.620521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1281963046 Aug 04 10:35:58.620521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-TestMinimumBasicScenario-1281963046-project Aug 04 10:35:58.620521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:35:58.620521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:35:58.620521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: edd0f098e40c4c2da8d55df9a8fa0912 Aug 04 10:35:58.620521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-TestMinimumBasicScenario-1281963046-project Aug 04 10:35:58.620521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:35:58.620521 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance d4b5f22b-45ce-40fe-8573-fcd858e5efed is not attached to volume 7c66668f-9a07-4929-8949-53ad26b75f50 Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'server_id': 'd4b5f22b-45ce-40fe-8573-fcd858e5efed', 'id': '7c66668f-9a07-4929-8949-53ad26b75f50'} Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7c66668f-9a07-4929-8949-53ad26b75f50. Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:35:58.621479 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b5f22b-45ce-40fe-8573-fcd858e5efed is not attached to volume 7c66668f-9a07-4929-8949-53ad26b75f50 Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b5f22b-45ce-40fe-8573-fcd858e5efed is not attached to volume 7c66668f-9a07-4929-8949-53ad26b75f50 Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:35:58.623016 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-fefcb4f0-c3bb-448c-b59b-f250753aa34f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Returning 404 to user: Instance d4b5f22b-45ce-40fe-8573-fcd858e5efed is not attached to volume 7c66668f-9a07-4929-8949-53ad26b75f50 {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:35:58.624199 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-fefcb4f0-c3bb-448c-b59b-f250753aa34f tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/os-volume_attachments/7c66668f-9a07-4929-8949-53ad26b75f50" status: 404 len: 154 microversion: 2.1 time: 0.091274 Aug 04 10:35:58.624199 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 524/1092] 10.222.0.72 () {58 vars in 1416 bytes} [Thu Aug 4 10:35:58 2022] DELETE /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed/os-volume_attachments/7c66668f-9a07-4929-8949-53ad26b75f50 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:35:59.758072 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4d00b862-bb1f-44ce-baac-3ba0fcec5177 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:59.758553 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4d00b862-bb1f-44ce-baac-3ba0fcec5177 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:59.764925 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4d00b862-bb1f-44ce-baac-3ba0fcec5177 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:59.765371 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4d00b862-bb1f-44ce-baac-3ba0fcec5177 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:59.766123 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4d00b862-bb1f-44ce-baac-3ba0fcec5177 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:59.766592 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4d00b862-bb1f-44ce-baac-3ba0fcec5177 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:59.792065 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4d00b862-bb1f-44ce-baac-3ba0fcec5177 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:35:59.867098 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4d00b862-bb1f-44ce-baac-3ba0fcec5177 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 204 len: 0 microversion: 2.1 time: 0.112544 Aug 04 10:35:59.867865 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 569/1093] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:35:59 2022] DELETE /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:35:59.876113 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-559e881d-3d54-4654-85c9-a84c937079ac tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:59.876719 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-559e881d-3d54-4654-85c9-a84c937079ac tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:59.882743 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-559e881d-3d54-4654-85c9-a84c937079ac tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:59.883181 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-559e881d-3d54-4654-85c9-a84c937079ac tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:59.883927 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-559e881d-3d54-4654-85c9-a84c937079ac tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:59.884377 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-559e881d-3d54-4654-85c9-a84c937079ac tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:00.011881 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-559e881d-3d54-4654-85c9-a84c937079ac tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:00.019440 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-559e881d-3d54-4654-85c9-a84c937079ac tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1554 microversion: 2.1 time: 0.147182 Aug 04 10:36:00.020019 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 525/1094] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:35:59 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:01.041351 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-19a6f50f-0249-47fd-a7fb-f5f04aa7338b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:01.042040 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-19a6f50f-0249-47fd-a7fb-f5f04aa7338b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:01.048470 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19a6f50f-0249-47fd-a7fb-f5f04aa7338b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:01.048908 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19a6f50f-0249-47fd-a7fb-f5f04aa7338b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:01.049653 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19a6f50f-0249-47fd-a7fb-f5f04aa7338b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:01.050082 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-19a6f50f-0249-47fd-a7fb-f5f04aa7338b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:01.184142 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-19a6f50f-0249-47fd-a7fb-f5f04aa7338b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:01.191653 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-19a6f50f-0249-47fd-a7fb-f5f04aa7338b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1554 microversion: 2.1 time: 0.155152 Aug 04 10:36:01.192247 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 570/1095] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:36:01 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:02.213113 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-34bb1cfc-b731-4a4e-8b5e-b65e3721094b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:02.213735 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-34bb1cfc-b731-4a4e-8b5e-b65e3721094b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:02.220476 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-34bb1cfc-b731-4a4e-8b5e-b65e3721094b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:02.220924 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-34bb1cfc-b731-4a4e-8b5e-b65e3721094b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:02.221697 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-34bb1cfc-b731-4a4e-8b5e-b65e3721094b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:02.222136 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-34bb1cfc-b731-4a4e-8b5e-b65e3721094b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:02.255748 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-c353c5d3-5d95-4d6c-b965-22088068d31e req-ead18227-58ef-4948-870b-8799c1bd74aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b5f22b-45ce-40fe-8573-fcd858e5efed", "name": "network-vif-deleted", "tag": "212d642e-6e42-4971-b584-f811951bcb45"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:02.267306 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-c353c5d3-5d95-4d6c-b965-22088068d31e req-ead18227-58ef-4948-870b-8799c1bd74aa service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:02.268162 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-c353c5d3-5d95-4d6c-b965-22088068d31e req-ead18227-58ef-4948-870b-8799c1bd74aa service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:02.283798 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-c353c5d3-5d95-4d6c-b965-22088068d31e req-ead18227-58ef-4948-870b-8799c1bd74aa service nova] Creating event network-vif-deleted:212d642e-6e42-4971-b584-f811951bcb45 for instance d4b5f22b-45ce-40fe-8573-fcd858e5efed on hv-cinder-82660 Aug 04 10:36:02.288958 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-c353c5d3-5d95-4d6c-b965-22088068d31e req-ead18227-58ef-4948-870b-8799c1bd74aa service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039005 Aug 04 10:36:02.289613 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 571/1096] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:36:02.294130 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-34bb1cfc-b731-4a4e-8b5e-b65e3721094b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd0f098e40c4c2da8d55df9a8fa0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d8ac72593445089042fd7c3a31651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:02.304178 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-34bb1cfc-b731-4a4e-8b5e-b65e3721094b tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 200 len: 1512 microversion: 2.1 time: 0.094802 Aug 04 10:36:02.304767 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 526/1097] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:36:02 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 1512 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:03.325875 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5041f534-bf18-47b1-a4e4-2f4156024a69 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:03.326494 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-5041f534-bf18-47b1-a4e4-2f4156024a69 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] [instance: d4b5f22b-45ce-40fe-8573-fcd858e5efed] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:03.332750 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5041f534-bf18-47b1-a4e4-2f4156024a69 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:03.333194 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5041f534-bf18-47b1-a4e4-2f4156024a69 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:03.333944 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5041f534-bf18-47b1-a4e4-2f4156024a69 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:03.334403 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-5041f534-bf18-47b1-a4e4-2f4156024a69 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:03.347798 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-5041f534-bf18-47b1-a4e4-2f4156024a69 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] HTTP exception thrown: Instance d4b5f22b-45ce-40fe-8573-fcd858e5efed could not be found. Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5041f534-bf18-47b1-a4e4-2f4156024a69 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Request method failure captured: Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed HTTP/1.1 Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi66B40vM1MMxTrdYgF7xlZEoUHhS481utTazy25e33tJX72E4HOWky6MBWdjJyOJJJS0hSUXcbgQDyQVFZyn-Vn0FKgvrih4Y61V5A9tKcfSvNfRfjCHpYlEH6t0E_PPNqBzewlnyRYFyLfjPlUU3xuetqH7Qx8wyLEmlU67hn-PMnhU Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: f63d8ac72593445089042fd7c3a31651 Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-TestMinimumBasicScenario-1281963046 Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:36:03.349445 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:36:03.351102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f63d8ac72593445089042fd7c3a31651"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f63d8ac72593445089042fd7c3a31651"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f63d8ac72593445089042fd7c3a31651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f63d8ac72593445089042fd7c3a31651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:36:03.351102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-TestMinimumBasicScenario-1281963046 Aug 04 10:36:03.351102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: f63d8ac72593445089042fd7c3a31651 Aug 04 10:36:03.351102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1281963046 Aug 04 10:36:03.351102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-TestMinimumBasicScenario-1281963046-project Aug 04 10:36:03.351102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:36:03.351102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:36:03.351102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: edd0f098e40c4c2da8d55df9a8fa0912 Aug 04 10:36:03.351102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-TestMinimumBasicScenario-1281963046-project Aug 04 10:36:03.351102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:36:03.351102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance d4b5f22b-45ce-40fe-8573-fcd858e5efed could not be found. Aug 04 10:36:03.351102 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': 'd4b5f22b-45ce-40fe-8573-fcd858e5efed'} Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b5f22b-45ce-40fe-8573-fcd858e5efed could not be found. Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:36:03.352064 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b5f22b-45ce-40fe-8573-fcd858e5efed could not be found. Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b5f22b-45ce-40fe-8573-fcd858e5efed could not be found. Aug 04 10:36:03.353667 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:36:03.355128 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-5041f534-bf18-47b1-a4e4-2f4156024a69 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Returning 404 to user: Instance d4b5f22b-45ce-40fe-8573-fcd858e5efed could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:36:03.355128 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-5041f534-bf18-47b1-a4e4-2f4156024a69 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed" status: 404 len: 111 microversion: 2.1 time: 0.029656 Aug 04 10:36:03.355128 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 572/1098] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:36:03 2022] GET /compute/v2.1/servers/d4b5f22b-45ce-40fe-8573-fcd858e5efed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:36:03.359449 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-d40f4c39-83f9-447c-90ea-1c81515f5944 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] Calling method '.version_select at 0x7fbaa49453a0>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:03.377895 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-d40f4c39-83f9-447c-90ea-1c81515f5944 tempest-TestMinimumBasicScenario-1281963046 tempest-TestMinimumBasicScenario-1281963046-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-196869657" status: 202 len: 0 microversion: 2.1 time: 0.022159 Aug 04 10:36:03.378450 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 527/1099] 10.222.0.72 () {58 vars in 1269 bytes} [Thu Aug 4 10:36:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-196869657 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:36:13.111751 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-46d127b7-e5c8-48ea-b9bf-10c175c39999 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:13.112297 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG dbcounter [-] [117667] Writing DB stats nova_cell1:SELECT=28 {{(pid=117667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:13.112662 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-46d127b7-e5c8-48ea-b9bf-10c175c39999 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:13.116665 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-9f342387-8161-4808-87db-aea886ae3c95 req-fa191d82-2e2f-4cf5-ab56-1e8553bf1e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b53386c-d4ab-449c-a60a-bcb1aaff42ea", "tag": "f73efd39-7084-4080-b354-dd511042f3ee"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:13.122983 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-46d127b7-e5c8-48ea-b9bf-10c175c39999 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:13.123454 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-46d127b7-e5c8-48ea-b9bf-10c175c39999 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:13.124516 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-46d127b7-e5c8-48ea-b9bf-10c175c39999 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:13.125015 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-46d127b7-e5c8-48ea-b9bf-10c175c39999 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:13.129624 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-9f342387-8161-4808-87db-aea886ae3c95 req-fa191d82-2e2f-4cf5-ab56-1e8553bf1e4d service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:13.130176 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-9f342387-8161-4808-87db-aea886ae3c95 req-fa191d82-2e2f-4cf5-ab56-1e8553bf1e4d service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:13.141535 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-9f342387-8161-4808-87db-aea886ae3c95 req-fa191d82-2e2f-4cf5-ab56-1e8553bf1e4d service nova] Creating event network-changed:f73efd39-7084-4080-b354-dd511042f3ee for instance 5b53386c-d4ab-449c-a60a-bcb1aaff42ea on hv-cinder-82660 Aug 04 10:36:13.148193 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-9f342387-8161-4808-87db-aea886ae3c95 req-fa191d82-2e2f-4cf5-ab56-1e8553bf1e4d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037626 Aug 04 10:36:13.151751 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-46d127b7-e5c8-48ea-b9bf-10c175c39999 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:36:13.152301 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 528/1100] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:36:13.250224 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-46d127b7-e5c8-48ea-b9bf-10c175c39999 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "DELETE /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 204 len: 0 microversion: 2.1 time: 0.141811 Aug 04 10:36:13.251805 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 573/1101] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:36:13 2022] DELETE /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:36:13.261355 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-e594a57a-add0-49d7-9c34-00cc360ce98e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:13.262494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-e594a57a-add0-49d7-9c34-00cc360ce98e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:13.270357 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e594a57a-add0-49d7-9c34-00cc360ce98e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:13.271063 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e594a57a-add0-49d7-9c34-00cc360ce98e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:13.272389 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e594a57a-add0-49d7-9c34-00cc360ce98e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:13.272822 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-e594a57a-add0-49d7-9c34-00cc360ce98e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:13.433755 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-e594a57a-add0-49d7-9c34-00cc360ce98e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:13.441352 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-e594a57a-add0-49d7-9c34-00cc360ce98e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1579 microversion: 2.1 time: 0.185024 Aug 04 10:36:13.441923 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 529/1102] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:36:13 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1579 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:14.463531 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-b873456f-28cf-4c41-8650-0a826254af36 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:14.464180 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-b873456f-28cf-4c41-8650-0a826254af36 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:14.470788 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b873456f-28cf-4c41-8650-0a826254af36 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:14.471249 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b873456f-28cf-4c41-8650-0a826254af36 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:14.472045 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b873456f-28cf-4c41-8650-0a826254af36 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:14.472503 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-b873456f-28cf-4c41-8650-0a826254af36 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:14.663773 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-b873456f-28cf-4c41-8650-0a826254af36 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:14.674138 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-b873456f-28cf-4c41-8650-0a826254af36 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1579 microversion: 2.1 time: 0.214607 Aug 04 10:36:14.675099 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 574/1103] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:36:14 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1579 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:15.697703 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-613d7a55-beb6-4f4d-b90d-4d45484dfe0a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:15.698241 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-613d7a55-beb6-4f4d-b90d-4d45484dfe0a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:15.705050 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-613d7a55-beb6-4f4d-b90d-4d45484dfe0a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:15.705503 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-613d7a55-beb6-4f4d-b90d-4d45484dfe0a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:15.706311 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-613d7a55-beb6-4f4d-b90d-4d45484dfe0a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:15.706768 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-613d7a55-beb6-4f4d-b90d-4d45484dfe0a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:16.157414 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [req-b7c9154f-95d1-4a24-92ab-46ad185da9e9 req-5f396bc7-190b-4bd5-8e57-fcfeb4839711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b53386c-d4ab-449c-a60a-bcb1aaff42ea", "name": "network-vif-deleted", "tag": "f73efd39-7084-4080-b354-dd511042f3ee"}]} {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:16.166294 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-613d7a55-beb6-4f4d-b90d-4d45484dfe0a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:16.182971 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-613d7a55-beb6-4f4d-b90d-4d45484dfe0a tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 200 len: 1460 microversion: 2.1 time: 0.489751 Aug 04 10:36:16.186081 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 530/1104] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:36:15 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 1460 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:16.187468 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-b7c9154f-95d1-4a24-92ab-46ad185da9e9 req-5f396bc7-190b-4bd5-8e57-fcfeb4839711 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:16.187913 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [req-b7c9154f-95d1-4a24-92ab-46ad185da9e9 req-5f396bc7-190b-4bd5-8e57-fcfeb4839711 service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:16.203135 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.compute.server_external_events [req-b7c9154f-95d1-4a24-92ab-46ad185da9e9 req-5f396bc7-190b-4bd5-8e57-fcfeb4839711 service nova] Creating event network-vif-deleted:f73efd39-7084-4080-b354-dd511042f3ee for instance 5b53386c-d4ab-449c-a60a-bcb1aaff42ea on hv-cinder-82660 Aug 04 10:36:16.208919 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [req-b7c9154f-95d1-4a24-92ab-46ad185da9e9 req-5f396bc7-190b-4bd5-8e57-fcfeb4839711 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054654 Aug 04 10:36:16.212154 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 575/1105] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:36:17.207072 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1a0ca1c0-b143-4eb8-99d3-dbbac15b99b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:17.207659 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-1a0ca1c0-b143-4eb8-99d3-dbbac15b99b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: 5b53386c-d4ab-449c-a60a-bcb1aaff42ea] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:17.214211 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1a0ca1c0-b143-4eb8-99d3-dbbac15b99b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:17.214662 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1a0ca1c0-b143-4eb8-99d3-dbbac15b99b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:17.215415 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1a0ca1c0-b143-4eb8-99d3-dbbac15b99b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:17.215869 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-1a0ca1c0-b143-4eb8-99d3-dbbac15b99b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:17.228759 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-1a0ca1c0-b143-4eb8-99d3-dbbac15b99b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] HTTP exception thrown: Instance 5b53386c-d4ab-449c-a60a-bcb1aaff42ea could not be found. Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1a0ca1c0-b143-4eb8-99d3-dbbac15b99b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Request method failure captured: Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea HTTP/1.1 Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi6571Qo0RGqhq4s9W-WkwAkEjtkuK8tHZdJKzuu8AuB0j6Tt9SC6K6S1d9-Y-geGfwQn7MDx90I_79gahKzd0SKMa1ePLNvqJjG9wzd1e3sBa6MKoqtPnQqcndKuvPOnEzAq4pmGJpJcOI7jC9O09a9mTVPvXy04powahpVcWRUNcudc Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 82b077dd80c54b08ba3ad79b8cafd3f7 Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:36:17.230347 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:36:17.232006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:36:17.232006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:36:17.232006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 82b077dd80c54b08ba3ad79b8cafd3f7 Aug 04 10:36:17.232006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:36:17.232006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-TestVolumeBootPattern-1536160160-project Aug 04 10:36:17.232006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:36:17.232006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:36:17.232006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: fd829e78e710440687678701fea3cf2c Aug 04 10:36:17.232006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-TestVolumeBootPattern-1536160160-project Aug 04 10:36:17.232006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:36:17.232006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance 5b53386c-d4ab-449c-a60a-bcb1aaff42ea could not be found. Aug 04 10:36:17.232006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': '5b53386c-d4ab-449c-a60a-bcb1aaff42ea'} Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b53386c-d4ab-449c-a60a-bcb1aaff42ea could not be found. Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:36:17.232969 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b53386c-d4ab-449c-a60a-bcb1aaff42ea could not be found. Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b53386c-d4ab-449c-a60a-bcb1aaff42ea could not be found. Aug 04 10:36:17.234610 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:17.236781 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-1a0ca1c0-b143-4eb8-99d3-dbbac15b99b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Returning 404 to user: Instance 5b53386c-d4ab-449c-a60a-bcb1aaff42ea could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:36:17.236781 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-1a0ca1c0-b143-4eb8-99d3-dbbac15b99b6 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea" status: 404 len: 111 microversion: 2.1 time: 0.028551 Aug 04 10:36:17.236781 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 531/1106] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:36:17 2022] GET /compute/v2.1/servers/5b53386c-d4ab-449c-a60a-bcb1aaff42ea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:36:20.297255 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-dfe5770c-a2ea-40f8-a6f5-001740e03867 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:20.297938 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-dfe5770c-a2ea-40f8-a6f5-001740e03867 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:20.298729 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-4c97b949-cd17-4143-9e84-76ac1c53b0ae req-50bd8ef7-e992-484b-9051-e4c23390ec2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73870ea-272e-4d63-adc0-0db553627ab6", "tag": "111adfd2-bc73-439c-9619-d4d37c3bfccd"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:20.304724 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dfe5770c-a2ea-40f8-a6f5-001740e03867 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:20.305165 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dfe5770c-a2ea-40f8-a6f5-001740e03867 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:20.306125 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dfe5770c-a2ea-40f8-a6f5-001740e03867 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:20.306989 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-dfe5770c-a2ea-40f8-a6f5-001740e03867 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:20.309847 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-4c97b949-cd17-4143-9e84-76ac1c53b0ae req-50bd8ef7-e992-484b-9051-e4c23390ec2e service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:20.310560 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-4c97b949-cd17-4143-9e84-76ac1c53b0ae req-50bd8ef7-e992-484b-9051-e4c23390ec2e service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:20.322359 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-4c97b949-cd17-4143-9e84-76ac1c53b0ae req-50bd8ef7-e992-484b-9051-e4c23390ec2e service nova] Creating event network-changed:111adfd2-bc73-439c-9619-d4d37c3bfccd for instance c73870ea-272e-4d63-adc0-0db553627ab6 on hv-cinder-82660 Aug 04 10:36:20.327837 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-4c97b949-cd17-4143-9e84-76ac1c53b0ae req-50bd8ef7-e992-484b-9051-e4c23390ec2e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032992 Aug 04 10:36:20.329021 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 532/1107] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:36:20.333677 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-dfe5770c-a2ea-40f8-a6f5-001740e03867 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Going to try to terminate instance {{(pid=117666) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:36:20.417873 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-dfe5770c-a2ea-40f8-a6f5-001740e03867 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 204 len: 0 microversion: 2.1 time: 0.124918 Aug 04 10:36:20.418582 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 576/1108] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:36:20 2022] DELETE /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 10:36:20.429005 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-758b0145-0b00-422c-918e-ec4378df3c7e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:20.429916 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-758b0145-0b00-422c-918e-ec4378df3c7e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:20.437006 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-758b0145-0b00-422c-918e-ec4378df3c7e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:20.437708 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-758b0145-0b00-422c-918e-ec4378df3c7e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:20.438488 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-758b0145-0b00-422c-918e-ec4378df3c7e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:20.438928 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-758b0145-0b00-422c-918e-ec4378df3c7e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:20.610847 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.policy [None req-758b0145-0b00-422c-918e-ec4378df3c7e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117667) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:20.619762 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-758b0145-0b00-422c-918e-ec4378df3c7e tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1578 microversion: 2.1 time: 0.196506 Aug 04 10:36:20.620434 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 533/1109] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:36:20 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1578 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:21.641897 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-2675edf3-770a-4b4c-8b49-51b0faa38c62 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:21.642586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-2675edf3-770a-4b4c-8b49-51b0faa38c62 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:21.649101 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2675edf3-770a-4b4c-8b49-51b0faa38c62 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:21.649555 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2675edf3-770a-4b4c-8b49-51b0faa38c62 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:21.650305 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2675edf3-770a-4b4c-8b49-51b0faa38c62 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:21.650731 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-2675edf3-770a-4b4c-8b49-51b0faa38c62 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:21.876027 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-2675edf3-770a-4b4c-8b49-51b0faa38c62 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:21.884181 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-2675edf3-770a-4b4c-8b49-51b0faa38c62 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1578 microversion: 2.1 time: 0.246556 Aug 04 10:36:21.884751 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 577/1110] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:36:21 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1578 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:22.435886 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [req-c54388b8-3708-4caf-84b5-97f3da797fa1 req-9598f299-e25c-4e32-bea0-0082b0a5b12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73870ea-272e-4d63-adc0-0db553627ab6", "name": "network-vif-deleted", "tag": "111adfd2-bc73-439c-9619-d4d37c3bfccd"}]} {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:22.448886 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-c54388b8-3708-4caf-84b5-97f3da797fa1 req-9598f299-e25c-4e32-bea0-0082b0a5b12c service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:22.449412 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [req-c54388b8-3708-4caf-84b5-97f3da797fa1 req-9598f299-e25c-4e32-bea0-0082b0a5b12c service nova] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:22.461746 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.compute.server_external_events [req-c54388b8-3708-4caf-84b5-97f3da797fa1 req-9598f299-e25c-4e32-bea0-0082b0a5b12c service nova] Creating event network-vif-deleted:111adfd2-bc73-439c-9619-d4d37c3bfccd for instance c73870ea-272e-4d63-adc0-0db553627ab6 on hv-cinder-82660 Aug 04 10:36:22.467923 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [req-c54388b8-3708-4caf-84b5-97f3da797fa1 req-9598f299-e25c-4e32-bea0-0082b0a5b12c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036331 Aug 04 10:36:22.468550 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 534/1111] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Aug 4 10:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:36:22.905285 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-4662b49a-7222-4153-881c-c4f91d8b2241 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:22.905831 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-4662b49a-7222-4153-881c-c4f91d8b2241 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:22.912373 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4662b49a-7222-4153-881c-c4f91d8b2241 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:22.912822 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4662b49a-7222-4153-881c-c4f91d8b2241 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:22.913588 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4662b49a-7222-4153-881c-c4f91d8b2241 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:22.914024 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4662b49a-7222-4153-881c-c4f91d8b2241 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:22.944235 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4662b49a-7222-4153-881c-c4f91d8b2241 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:22.944683 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-4662b49a-7222-4153-881c-c4f91d8b2241 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:22.945170 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.objects.instance [None req-4662b49a-7222-4153-881c-c4f91d8b2241 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lazy-loading 'fault' on Instance uuid c73870ea-272e-4d63-adc0-0db553627ab6 {{(pid=117666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:36:22.985980 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.policy [None req-4662b49a-7222-4153-881c-c4f91d8b2241 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd829e78e710440687678701fea3cf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b077dd80c54b08ba3ad79b8cafd3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117666) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:22.989507 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:22.995010 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-4662b49a-7222-4153-881c-c4f91d8b2241 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 200 len: 1229 microversion: 2.1 time: 0.093638 Aug 04 10:36:22.995580 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 578/1112] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:36:22 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 1229 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:24.017291 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c340b553-00d6-4d13-93ff-b479b86b4ad7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:24.017977 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-c340b553-00d6-4d13-93ff-b479b86b4ad7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: c73870ea-272e-4d63-adc0-0db553627ab6] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:24.025602 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c340b553-00d6-4d13-93ff-b479b86b4ad7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:24.026031 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c340b553-00d6-4d13-93ff-b479b86b4ad7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:24.026985 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c340b553-00d6-4d13-93ff-b479b86b4ad7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:24.027427 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-c340b553-00d6-4d13-93ff-b479b86b4ad7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:24.041519 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-c340b553-00d6-4d13-93ff-b479b86b4ad7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] HTTP exception thrown: Instance c73870ea-272e-4d63-adc0-0db553627ab6 could not be found. Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c340b553-00d6-4d13-93ff-b479b86b4ad7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Request method failure captured: Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 HTTP/1.1 Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi6571Qo0RGqhq4s9W-WkwAkEjtkuK8tHZdJKzuu8AuB0j6Tt9SC6K6S1d9-Y-geGfwQn7MDx90I_79gahKzd0SKMa1ePLNvqJjG9wzd1e3sBa6MKoqtPnQqcndKuvPOnEzAq4pmGJpJcOI7jC9O09a9mTVPvXy04powahpVcWRUNcudc Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 82b077dd80c54b08ba3ad79b8cafd3f7 Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:36:24.043252 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:36:24.044887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:36:24.044887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:36:24.044887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 82b077dd80c54b08ba3ad79b8cafd3f7 Aug 04 10:36:24.044887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:36:24.044887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-TestVolumeBootPattern-1536160160-project Aug 04 10:36:24.044887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:36:24.044887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:36:24.044887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: fd829e78e710440687678701fea3cf2c Aug 04 10:36:24.044887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-TestVolumeBootPattern-1536160160-project Aug 04 10:36:24.044887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:36:24.044887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance c73870ea-272e-4d63-adc0-0db553627ab6 could not be found. Aug 04 10:36:24.044887 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': 'c73870ea-272e-4d63-adc0-0db553627ab6'} Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c73870ea-272e-4d63-adc0-0db553627ab6 could not be found. Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:36:24.046104 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73870ea-272e-4d63-adc0-0db553627ab6 could not be found. Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73870ea-272e-4d63-adc0-0db553627ab6 could not be found. Aug 04 10:36:24.047494 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.048796 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-c340b553-00d6-4d13-93ff-b479b86b4ad7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Returning 404 to user: Instance c73870ea-272e-4d63-adc0-0db553627ab6 could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:36:24.048796 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-c340b553-00d6-4d13-93ff-b479b86b4ad7 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6" status: 404 len: 111 microversion: 2.1 time: 0.031630 Aug 04 10:36:24.048796 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 535/1113] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:36:24 2022] GET /compute/v2.1/servers/c73870ea-272e-4d63-adc0-0db553627ab6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:36:24.479417 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0414458c-8774-4f90-b97e-75d681d8dd02 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:24.479917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.compute.api [None req-0414458c-8774-4f90-b97e-75d681d8dd02 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117666) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:24.487990 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0414458c-8774-4f90-b97e-75d681d8dd02 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:24.488379 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0414458c-8774-4f90-b97e-75d681d8dd02 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:24.489153 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0414458c-8774-4f90-b97e-75d681d8dd02 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:24.489598 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG oslo_concurrency.lockutils [None req-0414458c-8774-4f90-b97e-75d681d8dd02 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:24.504266 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.wsgi [None req-0414458c-8774-4f90-b97e-75d681d8dd02 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] HTTP exception thrown: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0414458c-8774-4f90-b97e-75d681d8dd02 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Request method failure captured: Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: request: DELETE /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d HTTP/1.1 Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept: application/json Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Accept-Encoding: identity Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Connection: close Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Length: 0 Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Content-Type: application/json Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Host: 10.222.0.72 Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Openstack-System-Scope: None Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: User-Agent: python-urllib3/1.26.11 Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Auth-Token: gAAAAABi6571Qo0RGqhq4s9W-WkwAkEjtkuK8tHZdJKzuu8AuB0j6Tt9SC6K6S1d9-Y-geGfwQn7MDx90I_79gahKzd0SKMa1ePLNvqJjG9wzd1e3sBa6MKoqtPnQqcndKuvPOnEzAq4pmGJpJcOI7jC9O09a9mTVPvXy04powahpVcWRUNcudc Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Id: None Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Domain-Name: None Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Identity-Status: Confirmed Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Is-Admin-Project: True Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Id: default Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Domain-Name: Default Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Id: 82b077dd80c54b08ba3ad79b8cafd3f7 Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Project-Name: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Role: member,reader Aug 04 10:36:24.505950 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Roles: member,reader Aug 04 10:36:24.507586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:36:24.507586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:36:24.507586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Id: 82b077dd80c54b08ba3ad79b8cafd3f7 Aug 04 10:36:24.507586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-Tenant-Name: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:36:24.507586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User: tempest-TestVolumeBootPattern-1536160160-project Aug 04 10:36:24.507586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Id: default Aug 04 10:36:24.507586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Domain-Name: Default Aug 04 10:36:24.507586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Id: fd829e78e710440687678701fea3cf2c Aug 04 10:36:24.507586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: X-User-Name: tempest-TestVolumeBootPattern-1536160160-project Aug 04 10:36:24.507586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: method: > Aug 04 10:36:24.507586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: exception: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:36:24.507586 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: action_args: {'id': 'a50c1eff-d3b4-4002-8596-abeba3280c3d'} Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:36:24.508609 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:36:24.509917 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.511272 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-0414458c-8774-4f90-b97e-75d681d8dd02 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Returning 404 to user: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. {{(pid=117666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:36:24.511272 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-0414458c-8774-4f90-b97e-75d681d8dd02 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 404 len: 111 microversion: 2.1 time: 0.032448 Aug 04 10:36:24.511272 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 579/1114] 10.222.0.72 () {58 vars in 1239 bytes} [Thu Aug 4 10:36:24 2022] DELETE /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:36:24.516018 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a759f213-525e-4487-93d2-36734776c1de tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '>' {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:24.516662 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.compute.api [None req-a759f213-525e-4487-93d2-36734776c1de tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] [instance: a50c1eff-d3b4-4002-8596-abeba3280c3d] Fetching instance by UUID {{(pid=117667) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:24.523142 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a759f213-525e-4487-93d2-36734776c1de tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:24.523591 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a759f213-525e-4487-93d2-36734776c1de tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:24.524383 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a759f213-525e-4487-93d2-36734776c1de tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:24.524819 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG oslo_concurrency.lockutils [None req-a759f213-525e-4487-93d2-36734776c1de tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Lock "393fd0ff-f1f5-4df3-b996-afcdc2a85538" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:24.538450 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.wsgi [None req-a759f213-525e-4487-93d2-36734776c1de tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] HTTP exception thrown: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a759f213-525e-4487-93d2-36734776c1de tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Request method failure captured: Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: request: GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d HTTP/1.1 Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept: application/json Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Accept-Encoding: identity Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Connection: close Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Length: 0 Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Content-Type: application/json Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Host: 10.222.0.72 Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Openstack-System-Scope: None Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: User-Agent: python-urllib3/1.26.11 Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Auth-Token: gAAAAABi6571Qo0RGqhq4s9W-WkwAkEjtkuK8tHZdJKzuu8AuB0j6Tt9SC6K6S1d9-Y-geGfwQn7MDx90I_79gahKzd0SKMa1ePLNvqJjG9wzd1e3sBa6MKoqtPnQqcndKuvPOnEzAq4pmGJpJcOI7jC9O09a9mTVPvXy04powahpVcWRUNcudc Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Id: None Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Domain-Name: None Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Identity-Status: Confirmed Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Is-Admin-Project: True Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Id: default Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Domain-Name: Default Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Id: 82b077dd80c54b08ba3ad79b8cafd3f7 Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Project-Name: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Role: member,reader Aug 04 10:36:24.539931 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Roles: member,reader Aug 04 10:36:24.541547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_82b077dd80c54b08ba3ad79b8cafd3f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 04 10:36:24.541547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:36:24.541547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Id: 82b077dd80c54b08ba3ad79b8cafd3f7 Aug 04 10:36:24.541547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-Tenant-Name: tempest-TestVolumeBootPattern-1536160160 Aug 04 10:36:24.541547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User: tempest-TestVolumeBootPattern-1536160160-project Aug 04 10:36:24.541547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Id: default Aug 04 10:36:24.541547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Domain-Name: Default Aug 04 10:36:24.541547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Id: fd829e78e710440687678701fea3cf2c Aug 04 10:36:24.541547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: X-User-Name: tempest-TestVolumeBootPattern-1536160160-project Aug 04 10:36:24.541547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: method: > Aug 04 10:36:24.541547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: exception: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:36:24.541547 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: action_args: {'id': 'a50c1eff-d3b4-4002-8596-abeba3280c3d'} Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: {{(pid=117667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:36:24.542395 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. Aug 04 10:36:24.543848 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: ERROR nova.api.openstack.wsgi Aug 04 10:36:24.545311 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: DEBUG nova.api.openstack.wsgi [None req-a759f213-525e-4487-93d2-36734776c1de tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Returning 404 to user: Instance a50c1eff-d3b4-4002-8596-abeba3280c3d could not be found. {{(pid=117667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:36:24.545311 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO nova.api.openstack.requestlog [None req-a759f213-525e-4487-93d2-36734776c1de tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d" status: 404 len: 111 microversion: 2.1 time: 0.029197 Aug 04 10:36:24.545311 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: [pid: 117667|app: 0|req: 536/1115] 10.222.0.72 () {58 vars in 1236 bytes} [Thu Aug 4 10:36:24 2022] GET /compute/v2.1/servers/a50c1eff-d3b4-4002-8596-abeba3280c3d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 10:36:25.834929 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG nova.api.openstack.wsgi [None req-75359b7d-210d-4165-8b6f-d327aab26469 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] Calling method '.version_select at 0x7fbaa4ea6ca0>' {{(pid=117666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:25.842775 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: DEBUG dbcounter [-] [117666] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=3 {{(pid=117666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:25.858277 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO nova.api.openstack.requestlog [None req-75359b7d-210d-4165-8b6f-d327aab26469 tempest-TestVolumeBootPattern-1536160160 tempest-TestVolumeBootPattern-1536160160-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-274711633" status: 202 len: 0 microversion: 2.1 time: 0.027392 Aug 04 10:36:25.858946 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: [pid: 117666|app: 0|req: 580/1116] 10.222.0.72 () {58 vars in 1260 bytes} [Thu Aug 4 10:36:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-274711633 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:38:36.503496 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:38:36.504106 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Thu Aug 4 10:38:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:38:38.335600 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:38:38.336072 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Thu Aug 4 10:38:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:38:48.071987 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:38:48.072715 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Thu Aug 4 10:38:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:38:53.521170 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:38:53.521743 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Thu Aug 4 10:38:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:39:10.476272 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:39:10.476782 dv-cinder-826608-8-iscsi devstack@n-api.service[117666]: Thu Aug 4 10:39:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:40:31.775101 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:40:31.775715 dv-cinder-826608-8-iscsi devstack@n-api.service[117667]: Thu Aug 4 10:40:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!